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Eretaca 

The  purpose  of  the  research  presented  In  this  pqper  was  to  examine  the 
effects  of  applyiig  the  technk^cfcortrolvaricfes  on  tt^prin^ 
componerts  of  the  outputs  of  a  given  sfrriJk^^  Inthis  research  a 

corrtoncfion  of  dcta  and  variance  reduction  was  explored.  This  type  of 
expettnertcllon  may  be  generdzcbtefo  any  simularion  model. 

The  percentage  of  total  variance  explained  by  the  principal  components 
combined  wth  scatter  plots  of  tt^prirxapal  component  served  as  tte  "metrics" 
for  comparison  in  this  study.  Athoucfi  other  measures  of  effectiveness  may  have 
been  used,  the  metrics  used  herein  were  adequate  to  explain  the  flndhgs  for  this 
study.  The  experimentation  done  h  this  thesis  should  be  extended,  as  t  could  be 
of  signiflcart  vdue  to  analysts  comparng  attributes  of  simicr  systems. 
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document  in  search  of  innumerable  TaiKpas.-  Many  thanks  are  also  owed  to 
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The  purpose  of  this  reseaeh  was  to  examine  the  effects  of  applying  the 
technique  of  control  varictes  on  the  principal  components  of  a  cfven  model. 
The  investigciion  was  done  by  conpaing  three  sets  of  dcla  as  folows: 

1)  The  set  of  prindpd  components  of  theoutputs  of  the  model  on  which  no 
valance  reduction  has  been  appied, 

2)  The  set  of  prinqpal  components  of  variance-confroled  cxiputs-conlroi 
vaiafes  was  performed  prior  to  principal  componeits  analysis  being  done . 

3)  The  set  of  variance-confroled  principal  components--control  variates  was 
performed  on  the  princpal  components  of  the  outputs. 

The  comparison  of  the  effects  was  carried  out  by  examining  the  percentage 
of  variance  explained  by  the  principal  components  and  by  reviewing  the 
scatter  plots  of  the  flrsttwo  principal  components.  /  ^  v 


A  COMPARISON  OF  VARIANCE-CONTROLLED  AND 
NON-CONTROLLED  PRINCIPAL  COMPONENTS 


L  agdSKMKt 

E*p<?riroerfal  Dessn 

Systems  cfTerfrom  each  other  in  terms  of  values  of  system  parameters  end 
npd  variables.  These  varying  parameters  and  variables  are  eded  factors.  For 
example,  a  model  using  estimated  research  and  development  (R&D)  costs, 
production  costs  end  budgeted  finds  is  used  for  Ifecyde  costing.  The 
parameters  and  variables  include  the  costs  and  budgeted  Unds  and  the 
cfetrifcxJions  that  specify  these  costs  end  budgeted  tlnds. 

h  order  to  And  the  effect  of  a  factor  on  a  system,  the  factor  must  be  varied  or 
analyzed  at  efferent  levels.  (Alevelisapattciicrvciueofafactor.) 

Often,  models  contain  numerous  factors.  A  problem  of  analysis  resuls  when 
the  number  of  these  factors  is  hfgfi.  The  number  of  factor-level  combinations 
may  become  cumbersome  or  even  prohbllve  and  inhtot  dear  analysis.  For 
example,  7  factors  wlh  each  factor  having  2  levels  lead  to  27  or  128 
combinctlons.  Umlingtt^nLiTtoercfcomblx^^ 
andyzed  can  be  done  through  experlr>ertd  design.  An  e>qoerimenlal  design 
determines  a  subset  of  these  factor-level  combindions  that  may  be  able  to 
represent  the  stgillccrt  effects  of  d  the  combindNons. 
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Control  Varictes 

Another  problem  that  exists  when  analyzing  models  is  that  lage  valences  of 
the  outputs  can  Iml  the  illy  ^  These  imprecise  culputs  then  often  are 

used  for  other  rtcfierpiiposes  such  as  planning.  For  example,  the  outputs  of  a 
Sfecydemodet  are  used  for  planning  ftjndhg.  Mhmizingorcortrolngthe 
variances  of  the  otlpils  would  lead  to  more  mearincfU  and  accurate  pfenning. 

Methods  to  reduce  the  variance  of  a  variable  are  caled  varicnce  reduction 
techniques  (VRT).  VRTs  are  techniques  that  replace  the  original  scrnping 
procedure  (that  generated  the  variable)  by  another  procedure  that  yields  the 
same  expected  value  ofthe  variable  but  wlh  a  smaler  variance.  One  such  VRT 
is  the  method  of  control  variates. 

Control  variates  accompish  variance  reduction  by  taking  advantage  ofthe 
correlation,  if  any,  between  the  rpd  and  response  varieties.  Genercfy.the 
greater  the  correlation,  the  cheater  the  variance  reduction. 

Princjx*  C<ynp<yiQn^Anciy^ 

Large  valance  in  the  output  is  not  the  only  signitlcant  problem  in  modeling 
systems.  Often  the  outpds  of  a  model  can  be  irx:orriprehensfc>Je  because  of 
the  great  number  of  output  variables  that  need  to  be  interpreted .  Dda 
reduction  procedures  may  be  the  solution  to  these  types  of  problems . 
Spedflcaly,  the  technique  of  princ^al  components  andysis  may  be  cppled. 

Principal  componerts  andysis  takes  an  original  set  of  varieties  and  transfoims 
fintoasmeferset.  The  variables  in  the  smder  set  are  Inear  combinations  of  the 
variables  in  the  orighd  set  and  explain  much  ofthe  valance  of  the  tota  data 
that  was  contained  in  the  original  set.  The  objective  of  prbcjpd  componerts 
analysis  is  to  produce  as  few  as  possible  ofthe  princ^pd  componerts,  the 
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vciicblesinthesrnclerset.  thct  contains  as  much  of  the  rfonmatton  of  the  dcta  in 
the  original  set . 

Qbffdtvfe 

Ulle  research  has  been  accompished  in  Ihe  area  of  ejperimental  design 
wlh  vaiance  redudlon  end  princpal  components  cnatysis  as  appled  to  large 
modete.  The  research  that  has  been  completed  has  mdrty  been  Imled  to 
smd  classroom-size  modete. 

The  objective  of  this  research  was  to  examine  the  effects  of  perfomningthe 
technique  of  control  variates  on  the  principal  components  of  a  given  model 
Before  the  technique  of  control  variates  and  principal  components  analysis  can 
be  accompished.  data  on  which  the  technique  and  the  analysis  are  appled 
must  first  be  created.  The  data  thcT  were  created  were  the  outputs  of  a  given 
model.  The  outputs  that  were  created  were  required  to  be  represerf  alive  of  d 
the  outputs  the  model  can  produce.  Hence,  experimental  design  was  required 
to  specify  the  significant  factors  that  produced  the  representative  outpUs. 

The  comparison  of  the  effects  of  control  variates  and  principal  components 
was  accompished  by  comparing  three  sets  of  data.  The  three  sets  of  data 
were  as  fdows: 

1)  The  set  of  principal  componerts  of  the  c^iputs  of  the  model  cn  which  no 
variance  reductton  hod  been  appled. 

2)  Thesetcfprtnc^componertsofvariance<orfroledoulp(is-KXXf^ 
variates  was  performed  before  principal  components  andysis  was 
accompished. 

3)  The  set  of  variance-conlroled  principal  componerfs-cortrol  varicfes  was 
performed  on  the  princpal  components  of  the  oufptls. 
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The  compartson  of  the  effects  was  don©  by  examining  the  percertageof 
variance  explained  by  the  prindpd  componerts  and  by  reviewing  the  scatter 
plots  oftwoprtx^  componerts. 

figures  1  through  3  show  the  processes  the  model  went  through  for  each  sef  of 
data.  For  d  three  figures,  DQQmecns  the  ipilsoflhe  model  had  been 
experimertaly  designed,  SYS  means  that  the  model  was  rcn  wth  the 
e>perlmertcfy  designed  inpiJs,  PCA  means  principal  componerts  analysis  was 
accompished,  CV  means  variance  reduction  had  been  performed  through  the 
method  of  control  variates.  C  is  the  sef  of  controls,  Yis  the  orignd  sef  of  oilptls  of 

XV  XV 

the  model  Z  is  the  sef  of  principal  components,  and  *p)  and  Y[p)  ae  varicnce 
reduced  versions  of  Zand  Y. 

Casel.  The  first  sef  of  of  data  was  generated  from  an  experimertaly 
designed  model.  The  dafa  were  the  principal  componerts  of  the  outputs  of  the 
experimertalydesignedmodet.  figure  1  shows  the  experimented  design 
appied  on  the  model.  The  oriputs  of  the  model  were  then  transformed  Irto 
principal  componerts. 

Case  2.  The  second  sef  of  data  were  generated  from  the  modet  on  which 
experimental  design  end  vcrtance  reduction  have  been  appied.  The  data 
again,  were  the  principal  componerts  of  the  oriputs  of  the  experimertaly 
designed,  vartance-cortroled  model,  figure  2  shows  experimental  design 
being  performed  on  the  modet.  The  outputs  and  the  control  canddates  were 
then  used  to  find  the  vartance-cortroled  equivalents  of  the  original  outputs . 
Principal  componerts  cnalysis  was  appied  on  the  variance-cortroled 
responses. 
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Case  3.  Ihethird  setof  dcfa  were  genercfedfrom  an  e*qDeftr>ertciy 
designed  model  whose  outpils  were  first  transtamed  into  pdndpd  components 
before  variance  reduction  was  performed.  Rgue  3  shows  e>perimerlal  desigi 
appled  on  the  model.  Theoutpds  were  then  tiaistonmedintoprtrK^Dd 
components.  Control  varictes  was  appied  using  principal  components. 


c 


Figure  3.  Case  3 


1L  Bockyound  and  Uerdure  Review 

This  chqpter  reviews  terature  retevartto  the  research  proposal.  Spedflcdy, 
this  research  effort  required  a  lerdure  review  of  ejqDerimertddesigxcortiol 
vartdes,  and  principal  component  cndysis. 

Experimentd  Design 

Experimentd  designs  have  been  developed  since  the  1930s,  and  a  large 
amount  of  terafure  is  avaiabte .  However,  most  publcahons  do  not 
concenlrde  on  simulation  experiments.  Most  of  the  experimental  design 
terdure  address  techniques  needed  because  of  incomplete  corlrol  over  the 
experimental  conciions.  Thisisespeciciytiueinindustridandagiajl^ 
experimerts.  in  simutafion  experiments,  however,  the  anatyst"  has  til  cotItoI  over 
ci  of  the  factors.  He  simpty  rrx^es  changes  in  the  inptisef  the  compi/er 
program.  The  only  uncontroled  eiemert  is  the  pseudorandom  number  and, 
even  then,  the  analyst  can  control  the  seed  of  that  stream.  Therefore,  technical 
aspects  such  as  randomization  and  blocking,  which  are  dscussedto  a  great 
extent  in  the  experimental  design  terdue  are  ndcjed  concerns  in  simulation 
designs  (KJefnen  260-261).  Smiarty,  these  concepts  wind  be  dscussed  here. 

The  role  of  e>perimertd  design  is  to  dd  in  ittmdely  flndng  a  ILndtond 
relationship  between  the  inputs  end  outputs  of  a  system  of  interesMdealy,  an 
equation  thdworJddesabe  the  system.  One  way  of  ftndng  an  equdion  tor 
describing  a  system  is  usudy  to  examine  the  odpds  (or  responses)  of  a  system 
whose  input  variables  have  been  settoalpossfele  settings.  In  other  words,  by 
setting  the  system  mpd  variables  to  dl  posstole  combindtons  of  factors  and  dl 
possible  levels,  aid  then  studying  the  system  response  to  those  comblndtons, 
an  equdion  may  be  obtained  thd  ccn  adequately  describe  the  behavior  of 
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the  system.  However,  to  examine  the  system  cfeach  level  end  at  each  factor 
requires  N  computer  simulation  runs  where  N  is 


N-nLj 

where  factorj  has  Ljlevete  and  there  aek  factors.  N.  therefore,  can  be  a  large 
number  even  for  smal  values  of  j  end  k.  The  cost  and  time  associated  wlh  these 
compiler  runs  are  usucfy  the  Imltig  factors  in  an  experiment. 

fin  experimental  design  (ora  design  of  experiments)  is  used  to  restrict  the 
number  of  factor-level  combinations  (or  design  points)  that  must  be  examined 
whie  retaining  the  capably  to  have  sufficient  data  so  as  to  adequately 
describe  the  behavior  of  the  entire  system.  The  objective  of  a  design  of 
experiments  is  to  find  a  subset  of  combinations  thef  can  represent  d  the 
srgnflcarf  effects  of  al  the  combinations. 

In  an  experimental  design,  the  factor-level  combinaltons  or  design  points  to 
beiiJriaeconsoldatedinamctrtxcciedthedesignmdtbi^  If  the  design  matrix 
has  orthogonal  columns,  the  effects  of  factors  can  be  assessed  hdMdualy  and 
independently.  Rjther,  inducing  or  exdudng  a  factor  does  not  change  the 
estimates  of  the  parameters  associated  wth  the  other  factors.  (For  an  extensive 
description  of  the  properties  or  advantages  of  orthogonaly,  see  Box  and 
Draper,  1087:76-77  or  Neter  etd.  1966  60 1-602.) 

Ater  a  design  matrix  is  chosen,  a  model  can  be  formed  in  which  the  response 
or  response  vector  is  given  as  some  Unction  of  the  inpil  variables  and  a 
parameter  set  associated  wlh  the  inpii  variables.  The  model  ccn  be  written  in 
the  folowng  form 


y-f(x,p)  +  * 
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whereyisthevecforcffesponses.xisthevedorofinpiJs.p  isthepaameterset. 
and  t  is  the  expeflmeft d  error  (whk^  is  assured  to  ben 
zero  mean).  Once  a  functional  fom,  f,  has  been  found,  the  teast-squaes 
aferton  is  used  to  decide  which  values  for  pare  optimal.  (For  a  complete 
explanction  of  least-squares  aferton.  consul  Box  and  Draper.1987  34-67  or  Neter 
et  OI.198621Q238.) 

There  are  three  stages  in  experimental  design.  Theflrstisapreiminary 
investigation  of  the  fadors~in  this  stage,  the  analyst  identities  or  screens  the 
factors  or  factor  interactions  thcf  have  the  greatest  influence  upon  the  the 
response.  In  the  second  stage,  the  analyst ftjrfher  investigates  the  important 
factors  to  aducfy  select  the  factors  and  levels  (the  design  ports)  to  be 
inducted  in  the  experiment.  Theflnd$fageofane>^e<imerfdcte$ignisto 
detetmhe  whether  the  model  obtained  by  the  experimental  runs  is  adequate 
to  explain  the  system  (Ktefnen,T974265). 

Pretminqy  Investtgalion.  Designs  the#  are  useftJh  the  first  stage  of 
experimental  designs  include  two-level  factories  designs.  (Descriptions  of  these 
designs  may  be  found  in  Box  and  Draper, 1987.)  The  computer  smialton  is  run 
wlh  this  design  matrix  as  the  inptf.  The  outpUcf  the  sinxiction  is  the  vector  cf 
system  responses  where  each  response  is  associated  wlh  a  design  point.  A 
recession  is  performed  on  the  design  matrfc  and  vectorof  system  response  to 
obtain  the  p  values  or  parameter  set  assodefed  wlh  the  input  vartables. 

As  previously  mentioned .  the  object  of  this  first  phase  is  to  dscover  which 
effects  ae  signlicat.  A  common  method  for  checking  for  sigrilcance  of  effects 
is  by  plotting  the  paameters  assodefed  wlh  the  inpif  varieties  (obtained 
througn the IW stage  designs) on normd probably  paper,  rttneptofofan 
effect  fals  out  of  a  slraigt  Ine.  the  andyst  can  conclude  thef  the  effect  is 


9 


significant  and  should  be  investigated  Hither  (Bauer,T909:15-2O).  (Foradetaled 
explanation  of  the  technique  and  theory  behind  ncxmd  probcfcty  plots,  see 
Box  and  Drcper,T987:T28-134) 

As  a  point  of  interest  another  sipposedy  common  technique  (accordngto 
BensM:174)  is  cn  approach  where  the  andyst  provides  an  'a  priori"  probably  of 
an  effect  being  significant  and  then  cdaldes,  using  adud  experiment  tesuls, 
the  ‘a  posteriori"  probably  of  the  signiccnce  of  the  effect.  BensM,  however, 
offers  yet  another  atetndive  to  the  above  two  methods.  Hfe  method  combines 
atestfornoirnafy  wlh  a  test  for  otilers.  The  method  is  based  on  the  same 
assumptions  as  the  above  mentioned  techniques  but  does  not  require  the 
andystto  mcfce  subjective  assessments  concerning  elherthe  departure  from  a 
strdcft  Sne  or  a  priori  probabiies. 

Second  Stage.  Once  the  important  factors  and/or  factor  interactions  have 
been  discovered,  the  usuat  design  used  h  the  second  stage  of  cn 
experimental  design  is  a  fli  factorial  design  on  the  irrportantfactors  or  varicbles. 
In  a  fti  factorial  design,  d  the  factors  and  levels  are  examined.  The  rest*  of  the 
second  stage  design  is,  again,  a  vector  of  system  responses. 

A  regression  is  again  performed  on  the  til  factorial  design  matrix  and  the 
vector  of  system  responses.  The  p  values  or  pcrameter  set  associated  wth  the 
input  valdoles  are  obtained.  These  pvdues  are  the  coefficients  of  the 
associated  input  valables  in  the  model  thd  describes  the  system. 

AdeguacyoftheModel  The  model  obtained  from  the  second  stage  is  then 
checked  for  lack-of-flt.  By  comparing  the  actud  responses  of  the  system  to  the 
predcted  responses  of  the  model,  a  detennindlon  can  be  made  as  to  the 
adequacy  or  cptness  of  the  model.  Sevefd  methods  can  be  used  to  perform 
kxk-of-flttest.  These  include  the  exanmndlon  of  Mdtow's  Cp  stdlstlc,  R2  and 
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◦cJusted-R2  statistics,  residue!  analysis,  or  Rests.  Box  and  Draper  <1967,70-74)  or 
Neter  er  d  (1966.109-134^  discuss  various  approaches. 

c&mxs&tss. 

The  concept1  behind  the  theory  of  control  vertexes  is  Iheseledton  of  model 
inper  variables  wih  known  means  and  higfi  correlations  wfh  the  model  response 
variables.  The  correlations  of  the  inputs  and  the  responses  can  lead  to 
reductions  in  the  variances  of  the  responses 
Uwariate  Simulation  Response  wih  a  Sinfle  Control,  let  Y  been  estimator  of 
My,  where  My  is  an  esrimator  of  a  response  of  mreresf.  LefC  be  another  random 
variable  wih  known  mean  mc and  highly  correlated  wih  Ihe  response.  The 

variable  C  is  the  control  variable.  Thecortroledestlmcforisglvenby 

Y<b)-Y-b<C-Mc>  (2  2  1) 

where  b  is  a  constant  caled  the  control  coefficient 
The  variance  of  Y<b)  is  given  by 

Vor(Y<b))-Var(Y)  +  b2Var<C)-2bCov(  Y,  C)  (2.2.2) 

A  variance  reduction  wi  be  realzed  r 

2bCov<Y,C)>b2Vcr(C)  <2.2.3) 

The  cortioled  esltmcfor,  Y<b),  wl  have  a  smder  variance  then  the  uncortroled 
esflmcfor.  Y,  r  equeflon  (223)  holds.  CalaJus  reveals  that  Y(b)  has 
variance  when  b  is  set  ec|ual  to  the  optimal  control  coefllderr  given  by 
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o_  Cov(  Y,  Q 
p  Var(C) 


(2.2.4) 


Substtullng  (22.4)  Mo  (22.1)  yields  Ihe  optimal  conholed  estimator  Y(p) 
Y<p)-Y-C^^yi)(c-|>c)  (2  2  5) 


wth  the  minimum  variance  given  by 

Vcr(Y(p))-(l-p2>c)Var(Y)  (2.2.6) 


where  is  the  conelatton  coefficient  between  Y  and  C.  Since  the  corretatton 

coefficient1  in  (22j6)  is  a  squared  term,  the  sign  of  the  correialion  does  not  matter, 
only  the  magntude  does.  Thus,  the  higher  the  corretatton,  the  Ngfier  the 
variance  reduction. 

The  average  of  the  unconlroled  observations  Y  is  an  unbiased  poirt  estimator 
of  py.  The  average  cf  the  cortroled  observctions  y,(  p)  is  dso  cn  unbiased 

estimator  of  py.  This  is  given  by 


Y(p)-(i>2Y,(P) 


(2.2.7) 


where  Kb  the  sample  size  and 


Yi(p)-Yrp(C,-p0>  (2.2.8) 
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In  practice.  Cov(Y,0  end  Va(C)  are  unknown.  Therefore,  p  is  unknown  and 
nrusfbeestirncied.  Bauer  (T987a6)  gives  cn  rtulfve  approach  to  estimating  p 
byreplcx^theric^hand  side  of  (22.4)  win  the  appropriate  sample  statistics. 
This  yields  the  lecrf-squares  solution.  Uhderthe  assumption  of  joWnormafy 
between  Y  and  C.  the  least  squares  solution  is  also  the  maximum  IceYiood 
solution,  pis  estimated  by 


where 


and 


2<Yi-Y)<Ci-C> 

-*•  i«i 

p - - -  (2.2.9) 

Kq-c)* 

i-1 

*  Y 

Y-J^  <2. 2.  TO) 

i-1  * 


K  C 

C-2y  (2.2.  TT) 

i-l  * 


ThepoirtesHmcteof  jiy  is  given  by 


Y(p)-2 


Yj(P) 


(2.2. T2) 


i-1 


or 


A  A 


Y(P)-Y-P(C-mc>  (2 . 2 .  T3) 


The  variance  of  the  point  esttnetor  is  given  by 
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VCT(Y(P)).^i^M  (2.2.14) 

where 

Y(  |3)]-(  1  -  pyc)  Var(Y)  (2.2.16) 

Bauer  (1987a  £-9)  dso  provides  the  defection  of  the  htervd  esttmde  under  the 

assumption  of  jolt  notmcMy  between  Y  and  C. 
lhe  100(l*a)%  confidence  inteivd  on  the  poirt  esttmcforfbr  My  Is  given  by 

Y(|>)±  lk.sO-<%XV3r(Y(P))sn)/^  (2.2.16) 

where 

K  2 
2(Crnc) 
i*l 

Sjl. -  (2.2.17) 

K  _  2 
Kl(Cj-C) 
i-1 

andfk-2(  1  -  (x/2 )  8the  100(  1  -  <x./2 )  percertle  of  Studert'st-cSstitxJlon  wih  (k-2) 
degees  of  freedom. 

Since  p  is  esttmded,  a  smdter  variance  reduction  wl  be  realzed  than  t  p  is 

known.  The  loss  is  qucrtlfled  by  whd  is  ncnied  the  k^  factor  (Lf}.  IheLFb 
defined  as  the  rdtocf  the  variance  of  the  esttmdor  of  My  when  the  opttmd  pis 

rx^  knowa  to  the  vaiancedtheesttndor  when  pis  known.  Bauer  (1987a:9-10) 

provides  the  dertvdton  of  the  loss  factor  which  yields 

<2216> 

14 
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where  Q  is  the  rtmber  of  controls  and  K  is  the  number  of  teplcahons. 

This  loss  fader  ads  as  a  nmJipierto  the  rrtrminvakiicerdto(MV^ 
by 

(2. 2. T9) 

Var(Y) 

The  MVR  represerts  the  possbte  variance  reduction  when  the  optfrncri  cortrol 
coefficient- is  known.  Mul£lying  (22.18)  wlh  (22.19)  yields  the  vaiancercilo(VR). 
The  VR  represerts  the  possble  variance  reduction  when  p  Is  not  known 
(Bauer,1987a:9-10). 

Urwariate  Simulation  Response  w»h  MuHple  Controls.  Let  Y  be  Ihe  univariate 
response  wlh  variance  ay2,  C  be  the  <QXT)  vector  of  controls,  a^,  bethe(QXT) 
vector  of  covariances  between  Y  and  C,and  Ic  be  the  (QXQ)  covariance 
matrix  of  the  controls.  Then,  (22.13)  wth  mul^ple  controls  is  cjven  by 

Y(P)-Y-p  (C-*,)  (2.2.20) 

A 

where  p,C,  and  jic  are  (QXT)  vectors.  The  vector  of  optlmd  control  coefficients, 
is  then  given  by 


-l 


P*  (2 .2 .21) 


Since  the  covariance  mdrices  are  usudy  unknown,  p  can  be  estimated  by 
substtiiing  the  sample  anciogs  of  Xc  <nd  acy  rto  (2221).  This  leads  to  the 
folo  wing  equation 
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(2.2.22) 


P"  ScScy 

where  Sc  &  the  inverse  of  the  (QXQ)  sample  covariance  mdrtx  of  the  controls, 
and  S  cy  is  the  (QX1)  vector  of  sample  covariances  between  the  univariate 
response  and  the  vector  of  controls  (Bauer:1987a:12-13). 

Under  the  assumption  of  jolt  normc*y  of Y  and  C  Y(P)  Is  unbiased  for  jiY  and 
an  exact  100(l-a)%  confidence  interval  is  given  by 

np)  ►«.&!<  l-^DSyic  <2.2.23) 

where 


D2-  K''+(K-1  )'<  C-  *c)'sc<  C-*)  (2.2  24) 

Sylc-<  K-  Q- 1  )'<K.1)<  S2-  S„  Sc  S„>  <2 .2 .25) 

t  K-Q.i(1-a/2)  Is  the  100(l-<x/2)  percertle  of  Student’s  t-cSshtouhon  wth  (K-Q-l) 
degrees  offteedom,  and  Sy2  is  the  sample  variance  of  Y.  Experimental  resits 
have  shown  that  the  assumption  of  joint  rmltvaricte  namely  is  robust  (Bauer  et 
Ct 19882-5). 

Mul^Dle  SimUdion  Responses  wih  Mitple  Controls.  Bauer  et£i(1987b:l-3) 
provide  an  ourtne  of  the  theoretical  formulas  for  the  case  when  there  are  P 
response  variables  and  Q  control  variables.  In  terms  of  the  notation,  the 
invariate  response  Y  becomes  a  (PX1)  vectorof  response  variables,  p 
becomes  a  (PXQ)  matrix  of  control  coefficients,  and  the  sector  deviation  Sy 
becomes  the  sample  covariance  matrix  of  the  response  vector,  under  the 
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assumption  thd Ycnd  C  have  the  joirt  muttvarietenormdclstitxim 
unbiased  esftmdof  of  ^  end  an  exact  100(1-  cc)%  confidence  elpsoidforj^is 
given  by 

CV^ylSy'cmi^y)  <  P(K-GHXK-P-Q)'b  F<l-wP.K-P-Q)  <2 .2 .26) 

where  D2  and  Sy  c2  are  as  in  (2224)  and  (2225)  and  F0-*  mi,  m2)  b  the  100(1 -a) 
percertle  cf  the  fkJstitxIton  wth  mi  end  m2  degrees  of  tteedom  (Bauer  gtd, 
1987b  2). 


The  objective  of  principal  components  analysis  (PCA)  is  to  examine  the 
interdependence  structure  of  a  set  of  variables.  Some  spedfle  objectives 
hdude  deta  reduction,  rterpretefion.  and  testing  of  prior  hypothesis.  For  the 
purposes  ofthis  research,  the  variables  being  studed  are  the  response  variables 
of  a  system  c(  interest  end  the  specific  objectives  are  data  reduction  and,  to  a 
lesser  extent,  irterpretefion.  (The  system  of  interest  is  the  seme  system  on  which 
experimental  design  was  performed.) 

The  goal  cf  PCA  is  to  reduce  p  number  of  origind  variables  to  q  factors  wlh  q 
being  much  less  then  p.  The  characteristics  of  the  qfactors  may  be  more  ready 
irterpretedttxjithe  ctxjoctertstlcs  of  the  orighd  p  variables.  For  example,  let  p 
variables  represent  a  student's  scores  b  severd  tests.  Each  score  by  Isef  does 
net  reefy  provide  insist.  If  the  scores  were  somehow  corrpled  into  two  ratngs 
(the  qfactors)  thd  were  Inecrcomblncllons  of  the  p  scores,  the  factors  coda 
for  example,  represent  the  student's  mdh  end  verbd  apttudes. 
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LetXbeap<lmensJorK*icndomval^^ 
matrix  2.  Thecorx^pfbettndprtrx^conrponertscixalysisIstofMan 
of  vak±>le$,Y,  which  aemcoflelctedand  whose  vakxicesclec!ease--theftat 
variable  wotkj  contain  Ihe  largest  variance  whtethe  last  volatile  would  have 
the  least  (Dion 24-45).  Each  Mistaken  to  be  alneacombincfloncftheX'sso 
thcf 


Yj-aljX1+a2jX2+...  +  apjXp  (2.3.1) 

»OjTX 

where  aTj  is  a  vector  of  constants.  Equcfion  (2.3.1)  contains  an  ablrary  scale 

P  2 

factor.  Therefore, the concflonthcf  aTjaj-  1  Isimposed.  This 

normcfeatlon  procedure  ensures  thct  a  unique  solution  Is  obtained. 

The  list  prinapd  component,  Yi ,  Is  found  by  choosng  ai  sothct Yi  has  the 
lagestpossble  variance.  bother  words,  ai  is  chosen  so  as  to  rrodmce  the 
variance  of  aTi  X  subject  to  the  constraint  aTiOi-1. 

The  second  principal  component  is  found  by  choosing  a  2  so  Ihcf  Y2  has  the 
largest  possble  valance  for  cf  combinations  of  the  form  (25.1)  which  ae 
uncorrelated  wlhYi.  Smlarty,  Y3, ...,  Ypcre  chosen  so  as  to  be  unconetated  wlh 
each  other  end  to  have  decreasing  valance. 

Beghring  wlh  flndng  the  flret  component,  ai  is  chosen  so  as  to  maximize  the 
valance  of  Yi  subject  to  the  normcfeatlon  constraint,  aTiOj-1.  The  valance  of 
Yi  is  given  by 


Va(Y,)-Va(a{x)  (2.3.2) 

-  a]  2  Qt 
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Tims,  a]ia^  t$  the  objective  tlndion  to  be  rrx3^^ 

accepted  ptocedureldmaxirinizingaltncllon  of  severtf  varied 
to  one  or  more  constrairts  is  the  method  of  Lagrange  muftpiere.  This  method 
uses  the  rest#  from  the  calculus  at  a  stationary  poet.  The  partid  derivatives  of  a 
llixlton  subject  to  a  constr^  For  example,  grvenaflnctlonofp 

variables,  ....  Xp),  subject  to  a  constraint  g(xv Xp),  there  exists  a  scalar 

ededthe  Locpang^  mtipSer^ich^ 

— -A-^-0.  w . p  <2.2.3) 

5Xj  SXj 

at  any  stationary  point.  These  p  equations,  together  wih  the  constraint,  ere 
enoucfi  to  determine  the  coordnates  of  the  stattonary  points.  Further 
investigation  is  needed  to  see  if  a  stattonary  point  Is  a  maximum  minimum,  or 
sadde  point.  tlshelptUtofonTianewflrxdlon.  L(x).  such  that 

L(x)»f(x)-A(g(x)*c)  (2.3.4) 

where  the  term  in  the  square  brackets,  [g(x)-c],  iszero.  Then  the  set  of 
equations  in  (2.3.3)  may  be  written  as 

— -0  (2.3.5) 

Sx 

Applying  the  Lagrange  mullpler  method  to  (232)  wth  the  normabctlon 
constrait  yields 
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L<ai>-a5xarA(a5ar1>  (2.3.6) 

This  leads  to 

— -2Xar2Aa1  (2.3.7) 

*>i 

Setting  (2.3.7)  equal  to  0  yields 

(Z'ADarO  (2.3.8) 

The  idertly  mcttx  I  is  insetted  irto  (2  .3  .8)  so  that  the  term  in  brackets  is  of  the 
correct  order,  (p)p).  r(23.8)tetohavea$oUtonforc»ithcfteottTerthantheniJ 
vector,  then(  x- Ai)  must  be  a  singula  matte  Thus  A  must  be  chosen  so  thett 

1 2-AI  j»0  (2.3.9) 

Thus  a  non-zero  soUion  for  (233)  exists  raid  only  i  A  is  an  eigenvdue  of  x.  But 
x  wlgenerdy  have  p  eigenvalues,  which  must  al  be  normegattve  as  x  isa 
posltve  deflrte  matrix,  rthe  eigenvdues  are  denoted  by  Av  H ... ,  Apcnd 
assuming  they  are  dstinct,  the  eigenvdue  that  wl  determine  the  first  pxfndpctf 
componertttethelargesteigerrvclue,  Ai.  Then  using  (2  J5),  the  prlndpat 
componertai,  b  the  eigenvector  of  x  corresponding  to  the  lagest 
eigenvalue  (Chdfletd,190O:59-6O). 
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The  second  principal  component,  Y2  -  a1#  ,  is  obtained  by  an  extension  of 
Ihe  cbove  argument.  hajclkxifothesccir^constroitth^  ,a 

second  constraint  exists  thatY2  should  be  uncorrelatedwIhYi. 

The  covariance  between  Yi  and  Y2  Is  gtven  by 

Cov(YvY2)  -  Cov(  aT2X,  a^X)  (2.3.10) 

«E(aT2(X-jO<X*jOTar) 

-aT2z  c»i 

The  covariance  is  required  to  be  zero  If  Yi  and  Y2  are  to  be  uncorretated.  But 
since  Zai-Aioi.cnequivclentconclionisthcr  cf2at-0  .  In  other  words,  ai 
anda2  should  be  orthogonal. 

In  order  to  maximize  the  variance  of  Y2 ,  cP2 1  a2,  subject  to  the  two 
constraints,  two  Lagrange  mulipiers  are  introduced.  The  two  muHpters  are 
denoted  by  A  and  8  respectively.  The  function  for  mcDdmizIng  the  variance  of 
Y2ls0venby 


L(a2)*a52a2’A<a5a2-T)-8a5a1  (2. 3. IT) 

At  the  stationary  points 

— -2<Z*Al)a2-8a1-0  (2.3.12) 

8  Qj 


is  required.  ThtsequctfionprerriJIpledbycfigtves 


since  aTi<j2«0  .  Bifttom  (2.3.10),  aTi  za2isrequredfobezefO,sofhar  8  is 
zero  at  the  stationary  ports.  Thus  <2  3.12)  becomes 

<2-Al)O2-0  <2.3.14) 


Thistlnne  A  is  chosen  to  be  the  second  largest  eigenvalue  of  i,andi2tobe 
Ihe  cocrespondng  eigenvector. 

Conflrxingthte  agiiT)enr.  Ihe  bh  princpalcomponertresulsinthe 
eigerri/ectorassocictedvdhtte  largest- eigenvalue.  More  specflcdy.  the 

nomnatzed  eigenvectors  of  I  are  used  to  foim  the  principal  componerts  of  X. 
The  prindpci  components  ere  uncorretatedcrxj  the  vatancetf  principal 

componerf  is  Ai(OnaffleicL190O.tO). 

There  is  no  dffiaiy  in  extendng  the  above  agumerf  to  the  case  where 
some  ofthe  eigenvalues  of  1  areequd.  In  this  case  there  is  no  unique  way  tor 
choosing  Ihe  correspondng  eigenvectors,  txl  as  long  as  ihe  eigenvectors 
associated  wth  mulple  loots  are  chosen  to  be  orthogonal  the  argumect 
carries  through. 

An  importert  resul  from  principal  components  analysis  is  that  the  sum  ofthe 
variances  of  the  original  variables  is  equd  to  the  sum  of  the  variances  of  the 


principal  components,  tisctsopossbletostctethcfthe^principci 


componertaccourlsfor  aproportion  ofthe  total  variance  ofthe 


original  deta.  This  type  of  stolemeftmay  also  be  made  aboiithe  list  m 
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m 

Pi/ 

M  /p 

componef1s;thatthe1ttmcorrponert6accoirtforaproportion  f  °* 

i-i 

the  total  variance  (ChalfleicLIWAT). 

Using  the  Coneiation  Mdrtx.  Anateflx^wayofcclaJc^ 
components  is  by  transfonring  the  original  set  of  variables  der  they  have  been 
standatabed to haveurt variance.  This  essertialy  means  thaftheprinc^ 
components  are  obtained  from  the  coneiahon  matrix  P  instead  of  from  the 
covariance  mctrtx  2.  The  rrxd)emahcal  derivation  is  exactty  the  sc^^ 
eigenvector  are  eigenvector  of  P.  However,  the  eigenvectors  of  Pare  not  the 
same  as  the  eigenvectors  of  2.  By  analyzing  P  rather  than  2.  the  analyst  has 
decided  to  mcke  the  variables  equaly  importart-the  contribution  to  the  totd 
variance  is  equd  ford  the  variables  (Bauer,lW27-28 ). 

Forfhecotrelalion matrix. the  dagonatfemis  are  done.  Theorignal 
variables  cortribute  exactly  the  same  varicnce  before  principal  componerts 
analysis  is  peftocmed.  Thus  the  trace  (the  sun  of  the  dagonal  terms  of  a  square 
mctrix)  of  the  coneldion  matrix  is  equal  to  p  where  p  is  the  number  of  rows  of  P. 
The  sum  ofthe  eigenvalues  of  Pwi  also  be  equal  top.  Therefore,  the  proportion 
of  the  told  variance  crocourted  for  by  the  yh  component  Is  (Co*ns:62 ). 

Component  Looclngs.  Themclrtxofcorriponertloadhgsisamclrtxthd 
shows  the  correlahons  between  the  original  variables  and  the  principal 
componerts. 


Si/nmciy 

This  chapter  has  reviewed  the  tercfure  perttnertto  this  research.  An 
experimented  design  was  needed  to  produce  the  outputs  on  which  control 
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variates  and  pflnqpd  components  analysis  were  appled.  The  next  chapter. 
Chapter  3.  dscusses  the  actual  wo<k  the*  was  perfofmed  to  accompish  the 
objective  as  sfctedh the ftsf  chapter.  Chapter 4  wlpresertthe  resits  and 
Chapter  5  wfl  subntthe  conclusions  and  recommendcifons. 
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11L  Methodology 


To  achieve  the  research  objedtve,  the  concepts  dscussedh  the  teratue 
review  had  to  be  examined  hgeafdetal.  hadcltoaamodelhadtobe 
selected  and  a  computer  procjam  was  used.  This  chapter  dscusses  the  model 
used  in  the  research,  the  experimertci  design  employed  to  identify  the 
signikxjt  factors,  and  the  steps  that  were  taken  to  produce  the  data  specified 
for  the  three  cases. 

Model.  The  model  chosen  for  this  research  is  representative  of  a  dass  of 
queueing  systems  which  ere  frequently  analyzed  in  computer  performance 
modeing.  This  system  has  been  studed  etfensivety  end  workcfcle  control 
variables  have  been  developed  by  severe!  authors. 

The  smJahon  model  selected  for  study  in  this  research  is  a  model  of  the 
network  portrayed  in  Figure  4.  Node  1  has  N  servers,  where  N  is  the  flnfe  number 
of  customers  ofal  types.  This  node  mk^t  be  a  room  fled  wih  N  fteracttve 
computertermnals.  The  node  labeled  2  mi^t  be  a  holclng  area  or  buffer 
which  has  a  capacly  less  than  the  number  of  terminds.  The  nodes  labeled  3 
through  S  are  single  server  queues  wth  the  customers  being  served  in  order  of 
arivd  Node3migftbeacertrciprocessbgurf  (CPU)wfhnodes3through  S 
as  peripheral  devices  accessed  by  the  CPU. 

The  specific  modei  studed  in  this  research  has  a  totd  of  seven  nodes-the 
computer  room,  the  hddng  area  or  the  buffer,  the  CPU,  and  four  peripheral 
devices.  There  are  25  termincls  in  the  compiler  room  and  the  buffer  has  a 
capady  of  five  (Bauer,1987a:84-90). 

The  S  by  S  transiton  matrix  thd  characterizes  the  flow  of  customers  in  the 
network  has  the  form 
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P(d) 


0 

0 

Pi«*> 

0 

0 

0 

0 

0 


1 

0 

0 

0 

0 

0 

0 

0 


0  0  ...  0 

1  0  ...  0 

0  p*(d)  ...  p$(d) 

1  0  ...  0 

1  0  ...  0 

1  0  ...  0 

1  0  ...  0 

1  0  ...  0 


where  p*(d) .  k- 1 S .  Is  the  one-step  tronsflon  probably  (for  a  customer  cf 

typed)  from  node  3,  the  CPU  to  the  remaning  nodes ,  Table  1  shows  Ihe 
CK*udprobcb»e$  used  in  the  S  by  StrcrsttonmcWK. 


Table  l.  Transtton  ProbabWes  Rom  Node  3  to  Node  I 


Node  Probably 


1 

2 

3 

4 

5 

6 
7 


02 

0 

0 

0.36 

0.36 

0.04 

0.04 


In  this  network,  an  assumption  has  been  made  thcf  every  customer  that 
requests  service  from  the  CPU  is  immedctely  gated  access.  (However,  only 
five  customers  can  gain  entry  to  the  hokJng  area.)  Other  assumptions  ctxxi  the 
network  are  as  tolows  (Bauer,1987a^6): 
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1)  The  network  has  Martrovian  routing-the  next  node  vtsled  depends  only  on 
the  current  location. 

2)  the  service  limes  for  tire  j4h  type  of  customer  at  the  Mh  sendee  node  are 
drawn  ndependertty  from  a  given  probcbly  dsWtxiton.  F,j  (*).  wthfrte  mean 
and  variance.  There  is  rw  service  time  associctedwih  node  2,  the  btfler  or 
hc4dngarea. 

3)  Service  linn©  sequences  and  sequences  of  nodes  visted  ae  nmiuciy 
independent. 

An  infer esfing  feature  that  was  detberafety  but  into  the  model  was  that  nodes 
A  through  7  contitxie  equal  "delays"  ha  customer’s  time  m  system.  This  delay 
vciieofonetimeunl'lstoundbyrnullplyingthesteady-sf^  probably  of 
being  in  nodes  A  thiou^i  7  by  the  respective  node  mean  service  time. 

A  feting  of  the  simulation  program  tor  this  model  is  given  in  Appendx  1 . 

Experimental  Design.  In  orclerto  execute  the  research  as  oriined  in  the 
cases  described  in  Chapter  T,  Irtrodudion,  model  outptls  were  generated. 

The  outputs  generated  had  to  be  representative  of  d  the  posstole  outputs  the 
model  can  produce.  Thus,  an  experimental  design  was  implemented  on  the 
model  to  determine  which  of  the  model  parameters  are  significant-.  Once  these 
signlflcart  parameters  were  found,  another  design  was  then  used  to  produce 
the  outpristhd’  were  used  forflither  study  h  Cases  1,2,  and  3.  By  implementing 
an  experimental  design  on  the  model,  the  outpils  studted  were  representative 
of  the  model  oilpcls  as  a  whole. 

The  controlable  inputs  cflhe  model  are  the  service  times  ct  each  node.  The 
lypeofdsMtxJtoals  mean,  end  variance  describe  the  service  times  of  each 
node.  The  response  variable  examined  dulng  the  ejqoerlmertal  design  portion 
of  the  research  is  the  customer's  mean  time  in  system. 
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As  was  mentioned  n  the  ferafure  review,  a  prefrnhary  evc*jcfion  ofa  model 
is  needed  to  dete<mine  or  screen  the  importartfctfore.  A27  design  was  used  in 
this  prelmhary  phase.  (The  mean  service  time  was  ignored  atthfe  phase  to 
avoid  havhg  to  simulate  3?  design  points.)  This  means  that  a  til  factoid  was 
done  on  a  percentage  deviation  from  the  mean.  The  data  inUdy  used  was  ± 
10%  of  the  mean  service  time.  However,  plotting  the  effects  on  a  normd 
probably  plot  showed  no  effects  exhtflng  significance  at  the  10%  deviation. 
Changng  the  devidion  level  to  +  20%  led  to  flndhg  significant  effects  of  factors  A, 
5,  t,  and  7-service  times  for  nodes  4,  5, 6,  and  7  are  the  significcrtfactofs.  Figure  5 
shows  the  nonrnd  probcbly  pict  of  the  p  vdues  obtdned  torn  regressing  the  tli 
factoid  design  matrix  on  the  otipd^mean  time  in  system). 
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Figure  5.  Namd  Probcbly  Piofofthep  vdues 
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AfU  factodd  design  of  the  signiftccrt  mein  effects  was  fin.  Another 
regression  was  performed  on  the  system  response  and  model  ipUs  to  obtain 
Ihe  Anal  model.  (The  SAS  software  system  was  used  to  perform  the  regressions. 
The  SAS  runs  used  to  accompfeh  the  first  end  second  stage  of  the  ejperlmertal 
design  are  found  in  Appends  2.) 

Casel.  The  next  step  dterthe  experimental  design  was  to  execute  runs  of 
the  model  to  obtain  prirx^pd  component  of  the  octputs.  The  output  vectorthat 
was  studed  for  the  three  cases  cortahs  (T,  U(l),  11(3).  U(4),  U(5),  U(6),  U(7)J  where 
T  is  mean  time  in  system  and  U<j)  is  the  uffzcfion  rate  at  node  j.  The  model  was 
run  for  5000  time  uris  wth  the  sfottstlcs  cleared  after  the  first  2000  time  unis. 

Twenty  smidfon  runs  were  executed  at  each  of  the  design  ports  of  the 
design  mafrfx  selected  dterthe  expertmernfd  design  analysis.  The  design 
selected  was  a  fli  factorial  design  on  the  four  significant  factors-service  times  for 
nodes  4. 5. 6,  and  7-wtie  keeping  the  non-sigrflcart  factors  (service  times  tor 
nodes  1, 2,  and  3)  d  thee  mean  levels.  Anaddiond  setofiunswasmadewlh 
d  the  node  service  times  set  ct  the!  mean  levels-this  set  of  mns  is  labeled  as 
Design  port  T7.  The  design  mefrix  is  shown  in  Table  2. 

is  service  time  ct  node  j-the  vdue  "-T "  means  the  node  service  time  was 
set  to  20%  below  Is  mean,  the  value  T  means  the  the  node  service  time  was 
sefto  20%  above  Is  mean,  and  the  value  TT  means  the  node  service  time  was 
setto  Is  mean  value.  The  colunn  Icbeled  "Run'  shows  the  alphabetic  notation 
for  each  design  point.  A  spedd  notation  of  Tfeusedtorepresertthesetofnns 
when  cl  the  significart  factors  were  ettherlow  levels.  A  notation  of  "0"  is  used  to 
represent  the  design  port  in  which  d  the  node  service  times  were  at  the!  mean 
levels. 

The  mean  of  each  response  of  interest  was  obtained.  AT7by7dafamahb< 
resded-severteen  means  each  for  seven  responses  A  prfndpd  components 
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anatysis  was  performed  on  the  data.  Tcble  3  showsthe  origind  data  mcfrix-T 
stands  for  time  in  system  and  UQ  stands  for  utlzation  rated  node).  Nodes  land 
2  have  zero  utflzatton  rates.  The  prlnqpal  components  were  ototcried  through 
use  of  the  STAT1STIX  software. 


Design  point 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 
17 


Tcfc4e2.  Experimental  Design  Matrix 


XI  )Q  X3 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 

0  0  0 


X4  >€  Xb 

-1  -1  -1 

1  -1  -1 

-1  1  -1 

1  1  -1 

-1  -1  1 

1  -1  1 

-1  1  1 

1  1  1 

-1  -1  -1 

1  -1  -1 

-1  1  -1 

1  1  -1 

-1  -1  1 

1  -1  1 

-1  1  1 

1  1  1 

0  0  0 


X7 

1 

1 

1 

1 

1 

1 

-1 

-1 

1 

1 

1 

1 

1 

1 

1 

1 

0 


Run 

1 

d 

e 

de 

f 

dr 

ef 

def 

9 

og 

eg 

deg 

% 

efg 

defg 

0 


Case  2.  Forth*  case,  variance  reduction  was  performed  before  prindpd 
components  of  the  outputs  were  found. 

The  canddcfe  control  varieties  selected  ccn  be  classified  into  three  basic 
types:  1)  sendee  time  variables,  2)  flow  variables,  and  3)  work  variables.  Alof 
these  vaiables  were  colectedd  each  node  for  each  custornertype.  Service 
time  variables  are  the  sample  mean  sen/ice  times.  Row  variables  are  the 
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sample  proportion  of  departures  tom  patlaicffXxjesfetaWveto 
number  of  departures  ftomalnodes.  VVbrk  variables  ae  the  product  of  the 
service  time  variables  and  the  flow  variables. 


Table  3.  Doha  Used  in  Case  1 

Design  port 

T 

U3 

U4 

U5 

U6 

U7 

1 

15422 

0.4741 

0.3843 

02816 

02737 

02830 

2 

205J31 

0.4016 

0.4840 

02260 

02295 

02260 

3 

201.34 

0.4140 

02313 

0.4956 

0.3314 

0.3253 

4 

220.47 

02779 

0.4648 

0.4548 

02919 

02926 

5 

213.92 

0.3963 

02210 

02146 

0.4729 

02150 

6 

246.45 

02576 

0.4362 

02893 

0.4381 

02991 

7 

246.16 

0.3627 

02907 

0.4363 

0.4660 

02849 

8 

27226 

02283 

02927 

02886 

0.4103 

02669 

9 

214.46 

02962 

02142 

02186 

02201 

0.5084 

10 

248 j83 

02620 

0.4212 

02791 

02811 

0.4612 

11 

234.07 

0.3630 

02926 

0.4406 

02976 

0.4294 

12 

258.86 

0.3361 

0.4029 

0.4069 

02562 

0.4041 

13 

229.14 

0.3694 

02945 

02039 

0.4383 

0.4244 

14 

26120 

02469 

0.4186 

02746 

0.4066 

02825 

15 

273.79 

02318 

02674 

02986 

0.4162 

02991 

16 

304 j60 

02054 

02727 

02591 

02789 

02680 

17 

234.66 

0.3684 

02719 

02721 

0.3697 

0.3844 

The  work  variables  may  be  stendardfeedto  have  a  muttvariafe  normal 
dstifcxiton  wfh  a  zero  mean  vector  and  an  Identify  covariance  mctfrix.  This  is 
doneby  defining  the  work  variables  as 
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imrn'^oo- 


where  wk  -  relative  frequency  wth  which  a  customer  visfs  station  k,  and 

P(kj)  *  number  of  service  times  that  ae  finished  d  station  k  during  the  time  period 

((W)  (Lavenberg  etgL1962:182-202). 

The  moments  of  the  flow  variables  are  unknown  in  general.  Hence, 
standarcbcttonof  these  variables  cannot  be  occonnpIshecL  and  these 
carxJdate  cortrol  vanabtes  are  dscarded  in  favor  of  a  standadbed 
miilnorTWcortrol.  These  new  controls  are  caled  “rouhng  variables*. 

Al  routing  in  the  selected  model  is  done  ttom  the  CPU.  Define  an  hdfcator 
varicble  on  the  ever#  of  the  H*  depatue  from  the  CPU  to  station  j 

u. 

U,©«  lifthel  departing  customer  goes  to  stalionj 
»  0  otherwise 

From  the  description  of  the  model,  pj(*)  was  defined  to  be  the  probably  of 
transtion  from  the  CPU  to  station  j.  N(t)  is  the  total  number  of  transiions  ttom  the 
CPU  up  to  timet.  A  standarclzed  equdton  for  rolling  control  variables  is  then 

u,a>-Pi<*> 

**  Smvmm  tor)'l-  s,N®>0 

.0  if  NO  »  0 

I  can  be  shown  that  these  standarclzed  control  vartcbiesciso  have  the 
properties  of  zero  mean  vector  and  idertfy  covariance  matrix  <Bauer,T987aS6- 
97;Bauer,T907b:4). 
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A  computer  program  used  in  this  research  was  POST.FOR  (shown  in  ^ppendx 
3).  The  program  took  model  inptls  of  mean  service  times,  probably  of 
Iransilonftom  the  CPUto  any  of  the  other  nodes,  steady  stole  probdolies  of  a 
customer  being  in  a  particular  node,  and  the  actud  number  of  customers 
tronsitoning  ftom  the  CPU  to  a  patiaJcr  node,  and  cdaialed  the  standardzed 
wock  and  routing  variables.  Once  this  cdaJdlon  was  done,  control  varides  was 
accompfished  more  ready.  Data  thatiesuled  ftom  Case  1  runs  were  inputs 
dectty  for  POST.FOR. 

Reed  from  Chapter  2  the  review  on  control  variates.  The  equation  used  in 
control  variates  is  given  as 


XP)«Y-p<**> 

Y[p)  has  a  snrKJervariarrce  than  Yfconefcrflonexlsfs  between  the  inputs  and 
responses.  The  values  of  Y  are  obtained  drectty  from  the  oulpris  of  the  model 
and  the  terms  (X-jO  are  the  canddate  cortrols-the  standardzed  work  and 
rolling  variables- wlh  ji  being  a  zero  vector.  The  above  equation  can  then 
rewritten  as 


Y-XP)  +  p<*j0 

#ter  a  regression  is  performed,  values  of  the  responses  on  which  control  variates 
has  been  performed  is  given  drectty  by  the  ft  values  obtained  from  the 
regression.  Therefore,  varicnce-controled  values  of  the  responses  were 
obtained  through  regression  on  the  observed  Ycnd  the  control  ccnddates. 
*ppendx  4  contains  the  SAS  program  that  performed  this  regression. 
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Once  the  varicnce-cortroled  responses  were  obtained,  a  data  matrix  simiar 
tolhe  17  by  7  matrix  in  Case  1  was  constructed.  His  time  the  contents  were  seven 
vcilance-cortroled  responses  for  each  design  point.  The  data  matrix  is  shown  h 
Table  4.  TB  stands  for  variance-controled  time  in  system  and  UQB  stands  for 
variance-contrc4ed  utizatton  rate  for  node  j.  Principal  components  analysis  was 
performed  using  ttis  dda  matrtr. 


Tabled.  Data  Used  in  Case  2 


n  point 

TB 

U3B 

U4B 

U5B 

U6B 

U7B 

1 

155.17 

0.4772 

0.3791 

0.3837 

0.3766 

0.3766 

2 

205.54 

0.4011 

0.4749 

0.3237 

00296 

00144 

3 

201.34 

0.4086 

0.3297 

0.4956 

0.3235 

0.3381 

4 

221.78 

0.3818 

0.4582 

0.4528 

02904 

02939 

5 

206.39 

0.3953 

0.3251 

0.3146 

0.4728 

0.3226 

6 

23001 

0.3775 

0.4488 

02981 

0.4433 

0.3009 

7 

23828 

0.3646 

02960 

0.4386 

0.4476 

02910 

8 

257.17 

00418 

0.4051 

0.4114 

00950 

02672 

9 

210.59 

0.3962 

0.3152 

00176 

0.3129 

0.4955 

10 

243.90 

00561 

0.4256 

02866 

02698 

0.4394 

11 

234.57 

0.3660 

02907 

0.4274 

02983 

0.4316 

12 

269.55 

0.3287 

0.3989 

00991 

02585 

0.3953 

13 

24405 

0.3691 

02854 

02877 

0.4326 

0.4345 

14 

290.15 

00151 

0.3739 

02578 

0.3868 

0.3816 

15 

26105 

0.3379 

02702 

0.4093 

0.3981 

0.4236 

16 

294.14 

00098 

00773 

00637 

00718 

00633 

17 

234.71 

0.3624 

00692 

00722 

00601 

00849 

Case  3.  Case  3  folows  drectly  from  Case  land  used  ttie  same 
methodology  as  Case  2.  Since  the  princpd  components  were  cteady  found. 
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d  the*  was  needed  was  to  iun  the  control  variates  regression  using  the  prinqpd 
componerts  found  for  Case  1,  and  Ihe  same  inpif  variable  irtb<rndionu$edin 
Case  2. 

The  regression  of  the  principal  componerts  fomd  for  Case  1  and  the 
canddcfe  control  variables  described  in  Case  2  resuted  In  values  cf  p  which 
wefe  coefficients  of  the  adud  cortiol  variables.  Append*  5  contains  the  SAS 
progremthd  performs!^ 

Reed  agah  the  control  varides  equdton  given  by 

Xp).Y-p<X*> 

To  obtain  the  variarxe^ortroled  principal  componerts  of  the  model  (which  Is 
Ihe  purpose  of  Case  3),  the  above  equation  was  used.  Forltis  case,  Y  was 
actucfy  the  vector  of  principal  components  found  h  Case  1.  the  teims(X-|0 
were  the  means  of  the  canddate  cortiol  varieties  of  Case  Z  and  Xp)  were  the 
variance-  confided  prindpd  componerts.  Thevaiarrce-cortroledprirK^pd 
components  were  obtained  by  subtracting  torn  the  orighd  prindpd 
componerts  the  control  variables  mullpled  by  the  conespondng  p  value  fomd 
through  the  regression. 

The  netf  chapter  dscusses  the  cndysls,  comparison.  and  inference  obtained 
from  the  experiments. 


This  chqptef  presents  the  lesils  and  observations  gahed  alter  the 
experimentation,  descfbedhth©  previous  chapter,  was  completed. 

Model.  Thecoded  equation  tor  the  model  obtained  after  a  fUfactorid 
design  on  the  sigriflcGrt  effects  was  totnd  to  be 

Y«  212.888  +  21.469X4  +  14306X5  + 13388*,  +  8212X7  +  11.482X47  - 18.166*6 

where  Y  is  the  mean  time  in  system  and  Xj  is  the  mean  service  time  of  node  j. 

/Vi  examination  of  the  residua  plots  of  the  model  showed  aptness. 

Case  1.  The  STATIS71X  software  package  was  used  for  principal  components 
cndysis.  STATISTIX uses  the  ck*a  correction  matrix  h  compiling  piindpal 
components.  Adcfaconeiaiormct?fc<tx»cionesontheclc(gond.  Thiscan 
bertetprefedasciortgiridvcilcfclescorfTfcdlngthesamearrxxrtof 
varicrce-mamety.  one-before  principal  components  anciysis  Is  performed. 
Therefore,  ctterprindpct  componerts  analysis  has  been  pertained,  a  common 
procedure  for  clsccrdhg  principal  components  is  to  dscard  those  principal 
components  that  have  eigenvalues  less  than  one.  These  dscadedprindpa 
componerts  have  contrtxted  less  variance  than  cny  of  the  origfnd  variables. 

Table  5  shows  Ihe  STATISTIX  odptMor  Case  1.  The  table  of  eigenvalues 
showed  foaprricpacorinpooertswtheigenvciues  These 

focr  principal  components  eipldned  99.4%  of  the  totat  valence  of  the  data. 

The  eigenvectors  and  loadings  mctrtx  also  desatoed  Interesting 
characteristics  of  the  prindpet  componerts. 

1)  Looking  only  atfactorioaclngswlh  values  grecterthan  05,  principal 
componert  1  was  made  up  of  rime  in  system  and  the  CPU  itlzctlonrcte.  The 


lime  ii  system  coefflciert  of  the  badngs  matrix  was  of  opposie  sign  torn  the 
ifizattonrafe.  This  prinapdcomponert  may  be  considered  a  cor^^  time 
in  system  and  the  CPU  ufizaHon  rale.  The  description  of  the  network  model 
permis  the  folowing  interpretation.  fa  customer  is  noth  node  3,  fish  one  of  the 
other  nodes  driving  up  the  customer's  time  h  system.  Node3hasamean 
service  time  of  1  time  urt.  M  the  ether  node  mean  service  times  are  greeter 
lhan  one  time  urt.  fa  customer  is  utflzhg  node  3. 1  is  not  raising  the  customer's 
time  h  system  elsewhere. 


Tcfcte5.  STAT1STIX  Output  tor  Case  1 


Bgenvatues  %  of  Variance 


CumdaHve  %  of  Variance 


T 

2.050 

342 

2 

1.439 

24D 

3 

1279 

21.3 

4 

1.198 

20.0 

5 

2.637E-02 

0.4 

6 

7260E-03 

0.1 

342 

582 

79.5 

99.4 

99.9 

100.0 


Vectors 


actor 

1 

2 

3 

4 

5 

6 

T 

-05825 

0.0706 

-0.0315 

0.1573 

0.3996 

0.5862 

U3 

05736 

-0.1139 

0.0494 

-0.1866 

05698 

06064 

U4 

0.0717 

02440 

-0.8320 

-0.1068 

0.4146 

•02460 

U6 

0.1758 

-02967 

0.0891 

08149 

05897 

-02392 

U6 

-02067 

-0.6306 

0.1669 

-05006 

0.4291 

-05126 

U7 

08454 

0.6610 

0.5181 

-0.1215 

0.4504 

-02737 
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2)  The  second  princ^  component  cteo  had  Iwo  factors  wlhloaclng 
coefficients  gecfer  than  05-ilfzciloo  rate  of  node  6  and  utizaficnrcfe  of  node 
7.  The  signs  afthe  coefficients  dlhelocKahgsmdilx  were  opposfe.  Nodes  6 
and  7  have  equd  mean  service  time  and  the  probably  of  translion  from  the 
CPU  to  these  nodes  are  also  equd. 

3)  The  third  princ^componert  again  had  two  factors  wih  coefficients  greater 
lhcnOJ5-ullzationide$dnode4andnode7.  The  factors  were  also  opposteh 
sign.  Considering  tt^  description  cfthenx>delc(ows  the  folowir^ 

A  customer  has  a  036  probably  oftrcnsiloningfromthe  CPU  to  node  4  and 
node  4  has  a  mean  seivice  time  of  2.78  time  unis.  On  the  other  hand,  a 
customer  has  a  034  probably  of  transiioningfrom  the  CPU  to  node  7  btf  node  7 
hasameanseivicettmeof25j0tlrneunls.  Apparently  node  4  takes  away 
customers  that  corJd  go  to  node  7  because  customers  have  a  htgier 
probably  of  going  to  node  4.  Node  7,  however,  has  a  htgier  mean  service 
lime  and  thus  ties  up  customers  that  could  go  to  node  4.  ^ 

4)  The  fourth  principal  component  had  two  factors  witi  coefficients  greater  than 
05-Uizdion  rate  for  nodes  5  and  6.  The  interpretation  of  this  principal 
component  was  simiarfo  the  interpretation  of  the  third  principal  component. 

Factor  scores  were  obtained  by  mullptying  the  eigenvectors  of  the  prinapd 
components  by  the  original  variables.  Reed  the  equation. 


Yj-  ajjX,+ a2jX2+ ...  +  apjXp 

-OjTX 

from  the  Chapter  2  review  of  prindpd  components.  Y(  is  the  factor  score,  q  is 
the  eigenvector,  and  X  is  the  vector  of  orignd  variables. 
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The  factor  scores  of  the  four  principal  components  were  calcilated  tor  each 
design  portend  shown  in  Table  6.  PC(j)  stands  for  the  f1  principal  component. 

AscciterploTo(lhefifsflwoprinciprtcornponertisshowninRgie6.  Each 
port  has  the  a£hcbetic  notation  (described  in  Tcble  2)  to  hdccte  which  design 
port  I  represents. 


Table  6.  Factor  Scores  of  Case  1  Principal  Components 


1  Port 

PCI 

PC2 

PC3 

PC4 

1 

3.4697 

-03731 

0.1425 

-0.7841 

2 

12868 

0.4237 

-1.9106 

-0.6216 

3 

1.8444 

-0.9808 

0.3088 

1.6190 

A 

0.9750 

-0.1386 

-1.7468 

1.5305 

5 

0.3441 

-1.5632 

0.4368 

-1.4741 

6 

-0.7873 

-0.6696 

-13644 

-1.3675 

7 

-05614 

-22781 

05670 

0.4702 

8 

-15218 

-12036 

-1.0572 

0.4554 

9 

0.9338 

1.7328 

15393 

-05198 

10 

-0.3834 

2.4103 

-03363 

-0.5419 

11 

03085 

05646 

13488 

1.4648 

12 

-0.5000 

15152 

-0.4616 

1.4534 

13 

-02788 

-0.1083 

1.4744 

-1.3093 

14 

-1.1851 

0.5200 

-0.6228 

-12938 

15 

-15326 

-0.4746 

15118 

0.4884 

16 

-2.4880 

02843 

-0.1892 

0.4313 

17 

03761 

02388 

03596 

03891 

Case  2.  The  rest#  oftheregressiontoflndthevartance^ortroledoriptiscie 
shown  in  Table  4.  The  values  are  labeled  TB,  U3B,  U4B,  U5B,  U6B,  and  U7B  tor 
time  in  system  and  uffzahon  rates  of  the  node  j,  respectively  ,to  hdccte  thet 
control  variates  had  been  performed . 
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figure  6.  Scctter  Plot  of  the  first  Two  Principal  Components 


Again,  principal  components  analysis  was  performed,  this  time  on  these 
vatance-feduced  cxiputs.  The  STAT1ST1X  resufs  are  shown  on  Table  7. 

The  table  of  eigenvalues  shows  fourprtnc^componerthcMngeigenvcl^ 
greater  than  one.  ThettoijprlrK^palconponentacco(i1stor99^of1hetotc( 
variance. 

The  eigenvectors  and  toadngs  mcfrix  cteo  described  interesting 
characteristics  of  the  prindpd  corrponerts. 

T)  Looking  ortycffactorswlh  coefficient  values  gecterthan  05,  principal 
component  T  was  made  ip  of  the  variance-cortroled  time  in  system  and  CPU 
utlzalton  rate.  The  time  in  system  coefficient  of  the  toadngs  mcfrix  was  of 
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opposte  sign  from  the  uHzahonrcte.  TTTjsprirx^pcicorrponertmaybe 
considered  a  cortrasf  of  the  variance-controled  lime  in  system  andlhe 
variance-cortroled  CPU  liizdton  rcte.  lhescrri©e>qplcixaltoncanbom 
about  this  factor  pattern  as  the  e^xixtton  about  the  factor  pcttemoftheftst 
principal  componert  ofthe  original  outputs. 


Table?.  STATISTtX Output  for Case 2 


Eigenvalues 

%  of  Variance 

Cumulative  %  of  Valance 

1 

20% 

34.9 

34.9 

2 

1.426 

23.8 

58.7 

3 

T.312 

21.9 

80.5 

4 

1.T26 

18.8 

99.3 

5 

3250E-02 

0.5 

99.9 

6 

8.938E-03 

0.1 

100.0 

Vectors 

Factor 

1 

2 

3 

t 

TB 

0.6593 

-02043 

0.0272 

0.1429 

02179 

-0.6746 

U3B 

-0.6574 

0.1992 

-0.0376 

-0.1655 

0.1554 

-0.6893 

U4B 

-0.1368 

-0.6024 

0.4388 

-0.4030 

0.4937 

0.1406 

U5B 

-02475 

-08605 

0.1436 

08608 

-0.4066 

08965 

U6B 

-08021 

-0.1319 

-08636 

■0.1047 

0.4734 

0.1383 

U7B 

02305 

0.7312 

02373 

-0.1947 

08441 

0.1480 

2)  The  second  princ^  component  was  composed  of  the  variance-cortroled 
ilfzaHon  rafesfor  nodes  4  and  7.  The  interpretation  for  this  factor  pattern  was 
simiarto  the  interpretation  of  the  third  and  fourth  principal  components  found  in 
Case!. 
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3)  The  thrd  pfindpd  conponett  Ixxj  onfy  ooefactof  wtti  a  value  gecfer  than 
05.  This  princ^componert  is  reflecting  the  cortrbili^ 
cortrolediJlzctk^icteofrxxje6tothetD(dvcikTX». 

4)  The  touthprincjx*  component  cteo  only  had  one  factor  wlh  a  coefficient 
geezer  than  05.  This  prtncpd  component  is  reflecting  the  contribution  of  the 
variance-cortroled  uttzeiton  rate  of  node  5to  the  told  valance. 

Factor  scores  were  again  obtained  by  mJlplying  the  eigenvectors  of  Ihe 
principal  components  by  the  orignal  variables.  The  factor  scores  of  the  four 
principal  components  of  the  vaicrice-cortroled  outputs  are  shown  on  Table  8. 

A  scatter  plot  of  the  first  two  principal  components  of  the  vanance-controled 
outputs  is  shown  in  figure  7.  The  ports  have  the  alphabetic  notation  of  the 
design  port  I  represents. 


Table  8.  Principal  Components  of  the  Variance-Cortroled  CXiptis 


Design  Port 

PCB1 

PCB2 

PCB3 

PCB4 

1 

-3.3449 

0.9384 

-0.1871 

-0.6946 

2 

-1.3525 

-1.1938 

08400 

-12693 

3 

-1.7860 

0.3627 

0.3640 

1.7046 

4 

-12374 

-1.4968 

1.4654 

0.7373 

5 

•0.8664 

-0.0075 

-28467 

-08711 

6 

-03982 

-15708 

-08928 

-13736 

7 

•02494 

-0.4626 

-1.7237 

1.4777 

8 

02629 

-18831 

-03891 

0.7716 

9 

-0.1466 

2.3481 

05299 

-08199 

TO 

0.7985 

03961 

1.7400 

-13679 

TT 

02063 

1.4971 

0.6936 

1.1578 

T2 

12246 

-02186 

18251 

05919 

T3 

1.0424 

13402 

-1.3713 

-0.7304 

14 

23628 

-0.4618 

-03466 

-1.0602 

15 

12687 

1.1129 

-0.7747 

1.1487 

16 

2.0661 

-08150 

08371 

03733 

17 

0.1379 

0.1336 

0.1366 

08242 
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Figure  7.  Scatter  Plot  of  the  First  Two  Principal  Components  of  the 
Variance- Conlroled  outputs 

Case  3.  The  rest#  cfthe  regression  ofthe  principal  componerts  and  the 
control  varieties  resiled  in  the  folowing  four  equations: 

ZtCP)  -  Zi 

z  2<p)  -  z  2  -  (-1 .63369*  W1  +  3.78988*  VV7  -  3.00164*  R6) 
z3<p)  -  z3-  (-3.88701*W1  +  3 29738*  Wb) 

Z<<p)-Z« 

where  ^(p)  is  the  variance-cortroled  n-*  principal  component,  2^  is  the  orighd 
uncortrded  prindpd  components,  is  the  worirfrrg  variable  of  node  j,  and  R(  is 


44 


X 


the  routing  vcricfcte  of  node  j.  (^ppendx  5  contains  the  SAS  oufpds  of  the 
regression).  To  was  tcfcendredty  from  the  resuls  of  Case!  and  and  R,  were 

the  means  of  the  working  and  routing  varieties  used  in  Case  2.  Notethat 
variance  reductions  were  net  redzed  for  the  ftst  and  the  third  principal 
components. 

The  vaiance-controled  principal  components  at  each  deskyi  point  are 
shown  h  Table  9.  PC<j)B  stands  for  variance-cortroled  principal  component  j . 

A  scatter  plot  of  the  first  two  varfance-controled  principal  components  is  shown 
in  Figure  8.  The  ports  have  the  alphabetic  notation  ofthe  design  point  t 
represents. 


Table  9.  Variance-Controled  Principal  Components 


Design  Port 

PC1B 

PC2B 

PC3B 

PC4B 

T 

3.4697 

-0.7688 

0.3163 

-0.7841 

2 

12866 

0.5086 

-13008 

-0.6216 

3 

1.8444 

02873 

0.3637 

1.6190 

4 

0.9750 

-00043 

-0.6302 

15305 

5 

0.3441 

-0.6882 

-0.6065 

-1.4741 

6 

-0.7873 

-03483 

-10199 

-13675 

7 

-05614 

o.mo 

0.9994 

0.4702 

8 

-15218 

-05868 

•00964 

0.4564 

9 

0.9338 

-02272 

00226 

-0.6198 

TO 

-03834 

1.8325 

00508 

-0.5419 

IT 

0.3086 

0.3207 

-0.1132 

1.4648 

12 

•05000 

05998 

-05367 

1.4534 

13 

-02788 

-02093 

1.4333 

-13093 

14 

-1.1851 

13792 

-00791 

-12938 

15 

-1.5326 

-0.4677 

-0.6286 

0.4884 

16 

•2.4880 

-03923 

-00290 

0.4313 

17 

0.0761 

-0.1076 

03146 

0.0891 
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figure  8.  Sootier  Plot  cf  the  first  Two  Varkrice-Cortroled 
Prinapd  Componerls 


Qbservahons 

Both  sets  of  principal  corrponertis,  one  found  using  1t)e  original  outputs  and 
Ihe  other  using  the  vaiance-conlroled  outputs,  explained  relatively  equal 
percertages  of  the  total  variance  of  the  origind  data-cfcoif  99%.  Simiarty, 
ecK^irxaviciidptinc^corYiponertoft^  outputs  exptaineda 
relatively  equal  percertage  of  the  total  valence  as  Is  courtefparfprincipcri 
componert  of  the  variance-cortioled  otlpds.  Rjther,tt^latf  three  ptinepd 
componenlsh  each  set  had  reldfvely  equal  eigenvalues  or  explained  equd 
percertages  of  the  totd  valance. 
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Severe!  explanations  can  be  given  for  these  resets.  The  delays  Ihd  nodes  4 
throu^i  7  contributed  to  the  customer’s  mean  time  In  system  were  equd.  This 
condhon  dd  not  dow  any  node’s  effects  to  “overpower"  the  effects  of  the 
other  nodes.  This  chaacteristtc  may  hoveled  to  the  equd  percentages  of  the 
variance  explained  by  the  last  three  principal  components. 

Also,  the  model  chosen  may  not  have  necessarty  yielded  orthogond 
prindpd  components.  The  fact  that  the  lilzcfion  rate  of  node  7  loaded  wih  the 
uiizatlon  rate  of  node  6  on  the  second  principal  component  of  the  orighd 
outputs  and  then  loaded  wlh  the  uilzalton  rate  of  node  4  on  the  second 
principal  component  of  the  variance-coniroled  outputs  imply  lhat  the  prinepd 
components  were  not  orthogond.  That  the  utizdion  rate  of  node  7  "wavered" 
back  and  forth  as  to  whet  other  node  utizdion  rate  t  loaded  wlh  suggest  that 
prindpd  components  analysis  of  the  oulptls  dd  not  lead  necessaly  to 
orthogond  axes. 

Given  the  ecrter  dscussion  abodthe  incfvidud  prindpd  components  in  each 
case,  note  that  the  plots  thd  were  shown  for  the  prindpd  components  of  the 
orighd  outputs  and  the  prindpd  components  using  variance-controled  outputs 
dd  not  have  "parole!"  axes .  For  both  plots,  the  first  prindpd  component  was  a 
contrast  of  the  time  h  system  end  the  CPU  utizdion  rde.  However,  the  second 
princ£d  components  of  the  orignd  outpds  was  loaded  wlh  the  lilzdion  rdes 
of  nodes  6  and  7  wfie  the  second  prhc£d  component  of  the  varfance- 
cortroied  outputs  was  loaded  wihthevaricnce<or1roledLllzdtonfdesof 
nodes  4  and  7.  Interestingly  enough,  the  third  prindpd  component  of  the  the 
orighd  otipuls  had  shnlar  toadngs  as  the  fhid  prindpd  component  of  the 
varicnce-controled  odpuls. 

To  fac*de  a  more  meanincflJ  dscusston,  the  plot  of  the  princ^d 
components  of  the  orighd  oulpils  was  redawn  to  contah  the  flret  and  ttid 


prinqpd  componerts.  This  plot  should  sll  be  represertallve  of  the  variance 
e^Dtained  by  the  first  and  second  prinapd  components  since,  as  observed 
previously,  the  lasf  three  prinqpd  componerts  had  reidtvely  equal  cmout  of 
variances  ©xplahed.  This  ptof  is  shown  in  Rgu©  9. 

The  fblowing  dscussion  nestis  from  a  compafeon  of  the  plots  of  theprindpd 
components  of  the  orighd  outputs,  figure  9,  the  vafarx»-cortroled  otiptls, 
figure  1,  and  the  variance-cortroled  prindpd  componerts,  figue  8  : 


figure  9.  Scoffer  Plot  of  tire  first  aid  Third  PrlDcpal  Componerts 


1)  The  des^  port  h  wtiich  ci  the  signlteart  nodes  were  at  their  hicfi  mean, 
end  low  levels,  respectively,  were  labeled  wlh  Manxes.  The  design  ports  which 
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have  just  ttieerKxjescf  their  hkji  levels,  20%  above  the  mean  were  labeled 
wth  recfcncfes.  The  design  points  which  have  justtwo  nodes  at  their  Hgft  levels, 
were  labeled  wlh  circles. 

2)  The  points  representing  d  the  sigpticart  nodes  atther  hicfi  and  tow  levels 
ocaied  on  opposte  sides  oftheduster  of  ports.  The  port  representing  d  the 
nodes  cf  their  mean  levels  seemed  to  be  h  the  midde  of  the  other  two  points. 
This  pdtem  presented  isef  more  deafly  wih  the  princpd  components  of  the 
ortghd  oufpils. 

3)  The  ports  seemed  to  be  progressing  along  the  flrstprindpd  components 
axis  as  the  number  of  nodes  cftheirhigi  levels  hcrease-^heredancpes,  as  a 
whole,  were  cbead  of  the  cirdes,  as  a  whole,  which  were  ahead  of  the 
unlabeled  points  (which  represent  having  only  one  nodect  Is  higfi  level.)  This 
trend  appeared  more  marked  for  the  principal  components  of  the  vartance- 
cortroledoilpiis.  The  observation,  mentioned  previously,  cboutfhe 
nonorihogonaRy  of  the  axes  seem  to  be  supported  by  this  observation  of  the 
plots.  The  progression  of  points  as  the  number  of  nodes  at  Is  higji  level  increase 
appeared  to  be  along  a  path  the*  is  a  Sneer  combincfion  of  the  axes,  not 
merely  dong  just  the  first  principal  component  ads. 

4)  A  dashed  ine  drawn  on  the  plot  of  the  principal  components  of  the  original 
outpris  separates  those  ports  wlh  node  4  ct  Is  high  level  and  node  4  at  Is  low 
level.  Those  ports  wih  node  4  cf  Is  Ngji  level  seemed  to  be  farther  ip  on  the 
third  principal  component  axis.  The  fddorloaclngs  on  this  principal  component 
were  ch/lded  between  the  ilizalton  rates  of  nodes  4  and  node  7.  The  factor 
loadngs  were  opposte  h  step  and  the  loadng  for  node  4  was  Ngfier  in 
magniude.  Appaertty  node  4  cf  Is  Ngfilevel  tended  to  drive  thteprindpd 
component  down. 
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5)  A  dashed  In©  drawn  on  theptotoftheprinc|x*corrponenls  of  thevatcnce- 

controled  aiptis  separates  those  ports  wfh  nod©  7  at  Is  hig^  level  and  nod©  7 
at  Is  low  level.  Those  poitswlh  node  7  at  Is  level  seemed,  as  a  whole,  to 

be  father  143  on  the  secortoprinc^corrponert  The  factor  loadngs  on 

Itis  pdnapd  componert  were  dh/ided  between  the  varfaK^<x)rtroled 
utizdlon  rates  of  nodes  4  and  7.  The  factor  loadngs  were  opposie  in  sign  end 
lheloadhgfanode7wasttctierhmagnlude.  Apparerfly,node7cflshi0i 
level  drives  this  principal  component  up.  This  pattern  of  dvtslon  dong  thelevetof 
a  factor  is  more  dearly  seen  wth  the  plot  of  the  principal  components  of  the 
varkTK:e-controled  outputs. 

6)  In  the  plot  of  the  vatance-cortroled  prinqpd  components,  the  ports  "dg" 
(nodes  4  and  7  at  their  hi^i  levels)  and  "dfg"  (nodes  4, 6,  and  7)  cf  their 
levels  seemed  to  be  separated  from  the  mah  duster  of  points. 
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V.  Factor  Anctysis 

Since  the  pmcpd  components  andysis  presented  unciear  resuls,  a  factor 
analysis  analogous  to  the  principal  components  analysis  was  performed.  Factor 
arxJysis  is  simicrtoptinc|x(componertsandysish1hdcB  few®  possible  new 
variables  are  used  to  explain  the  variance  of  the  oricjnd  data.  In  the  case  of 
principal  components  analysis,  the  total  variance  cf  the  original  dda  Is 
considered.  In  factor  analysis,  however,  only  the  pat  of  thetotd  variance  thd  is 
shared  by  the  original  variables  are  explored. 

The  interpretation  of  factors  (the  new  varidDles)  h  factor  andysis  is  often 
complected  by  having  many  factors  wih  modercte-sized  loadngs,  d  of  which 
are  significant.  bother  words,  an  orighal  varictle  loads  on  more  than  one 
factor.  A  concept  eded  factor  rotdton  attempts  to  remedy  the  problem.  A 
factor  rotation  ninimfcestt^nLiTtoefdsigrt  each  row  of  the 

pattern  matrix  (of^mdy,  one  significant  foadng  perorighd  variable)  and  to 
maximize  the  number  of  loadngs  wfh  neglgble  vdues  (Dloal984t9). 

A  type  of  rotation  used  n  this  research  was  a  VARIMAX  rotation.  In  this  rotation, 
the  variation  of  the  squared  factor  loadngs  wihin  a  factor  is  maximized 
(Kdser,T968.T89-2Q0). 

The  three  cases  of  factor  analysis  data  thcf  were  compared  were  l)the 
factors  of  the  ocfputs  of  a  model  on  which  no  control  varides  had  been 
cppled,  2)  the  factors  of  the  outputs  of  a  model  on  which  control  variates  were 
first  cppled  end,  3)  the  v<dance<orlroled  factors. 

Case  T  Methodology.  Tcble  3  showed  the  orighdddamdtfc-T  stood  for 
Ifmein  system  andUQ  stood  for  ilizdion  rated  node  j.  Nodes  1  end  2  had 
zero  ut*zafion  rctes.  Factor  andysis  was  performed  using  this  orighd  data  matrix. 
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Case  2  Methodology.  Fortfts  case,  variance  reduction  was  performed 
before  factor  analysis  of  outputs  was  completed.  The  actual  steps  taken  to 
perform  the  Case  2  factor  analysis  were  eqdvdenfto  the  steps  tcrten  to  perform 
the  Case  2  princpal  components  cnatysis. 

Case  3  Methodology.  Case  3  foloweddrecttyftom  Case  land  used  the 
same  methodology  as  Case  2.  Since  the  factors  were  already  found,  althcf 
was  required  for  this  case  was  to  run  the  control  varictes  regression  using  the 
factors  found  in  Case  1  and  the  same  input  variable  rtormalton  used  in  Case  2. 
The  steps  used  to  And  the  varkrce-controled  factors  were  simlartoflncinglhe 
variance-corfroled  principal  components. 

Case  T  Resits.  The  SAS  software  system  was  used  to  perform  the  factor 
cnatysis.  The  output's  of  the  hital  factor  analysis  wfhout  any  rotation  of  the  axes 
were  very  smtarfothe  Case  1  principal  components  analysis  outputs. 

The  fable  of  eigenvalues  showed  four  factors  wfh  eigenvdues  greater  then 
one.  The  four  factors  explained  99.4%  of  the  variance  of  the  data. 

The  eigenvectors  and  factor  petfem  matrix  were  snriarto  the  eigenvectors 


and  petfem  matrix  of  the  principal  components  analysis. 

flter  a  VARIMAX  rotation,  the  above  facfor  patterns  changed  for  the  third  and 
fourth  factors.  The  rotefed  third  factor  had  a  significant  loadhg  of  the  ulizallon 
refe  of  node  4  only  wtie  the  rotated  fourth  factor  had  a  significant  loadhg  oflhe 
utlzctfon  rde  of  node  5  only .  TableTO  shows  the  rotated  factor  pattern  for  Case  1 . 

Fdctor  scores  were  obtained  by  nxflplying  the  eigenvectors  of  the  factors  by 
the  orighd  variables.  Factor  scores  are  given  by  the  folowhgequciton 


Yj-ajjX1+a2jX2+...  +  ap(Xp 

-ajTX 
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where  Yj  is  the  factor  score,  af  is  the  eigenvector,  and  X  is  the  vector  of  original 
vaictoles. 


Table  10.  Rotated  Factor  Partem  for  Case  1 


Factorl 

Factor2 

Factor3 

Factort 

T 

-0.9928 

-0B496 

-02413 

-08591 

U3 

0.9962 

0.0010 

0.0032 

0.0386 

U 4 

0.0331 

-0.0586 

0.9838 

-0.1058 

U5 

0.0773 

-0.0624 

-0.1369 

0.9833 

U6 

-0.0412 

-0.7822 

-0.4768 

-0.3919 

U7 

02270 

0.8964 

-02983 

-02177 

The  factor  scores  of  the  fourfacfcxs  were  calaJcted  for  each  design  port. 
Table  11  shows  the  factor  scores  for  Case  1.  Scatter  plots  of  IheltrsT  factor  against 
each  of  d  the  other  factor  are  shown  in  figures  10  through  12.  Each  point  on  the 
plot  has  the  alphabetic  notation  (shown  in  Table  2)  to  hdcafe  which  design 
port!  represents. 

Case2  Resiis.  The  rest#  of  the  regression  to  And  the  vakJTce-controled 
outputs  were  shown  on  Table  4.  The  values  are  labeled  TB,  U3B,  U4B,  USB,  U6B. 
and  U7B  for  time  in  system  and  lifedton  rctes  of  the  node  j,  respectively,  to 
rxfcxtethcf  cortiol  variates  had  been  performed . 

Again,  factor  cnc^  was  petfoimed,  this  time  on  these  variance-conlroled 
cxlpufs.  ltieeigen\toiuescixltdctorpcftenisobtcir^wttKxltherotationwefe 
simiarto  the  principal  corrponertscna^oil^  The  table  showed 

fourfcK^orewiheigenvcIuesgrecferthanone.  The  foarfadore  accounted  for 
992%  of  the  variance. 
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The  eigenvector  and  loadngs  mcWx  ciso  were  simlartoth©  eigenvector 
end  looclngs  mertx  of  the  Cose  2  principal  components. 


Table  Tl.  Factor  Scores  of  Case  1  Factors 


Design  Point 

Factl 

Fact2 

Fact3 

Fact4 

T 

2.5468 

-08162 

08214 

-0.1025 

2 

0.8546 

-02267 

1.7748 

-0.4211 

3 

0.999T 

-0.1396 

-0.3007 

1.8666 

4 

02392 

-02236 

1.5593 

15100 

5 

0.7477 

-12966 

-08144 

-0.9033 

6 

-02269 

-T2543 

0.8362 

-1.1327 

7 

-02005 

-1.4923 

-1.1807 

0.7936 

8 

-TJ0464 

-12981 

0.4606 

0.4367 

9 

0.6622 

1.7745 

-08579 

-0.7801 

TO 

-0.4T42 

15751 

08638 

-18224 

TT 

-0.TT83 

12160 

-08578 

1.1574 

T2 

-0.8443 

12318 

08091 

08731 

T3 

0.1920 

0.0731 

-1.3334 

-1.1645 

T4 

-0.5968 

-0.1680 

0.5059 

-1.3903 

T5 

-1.0002 

0.0479 

-15649 

02837 

T6 

-15037 

-08266 

08555 

-08417 

T7 

0.0088 

02233 

0.0234 

0.0375 

rtter  a  VARIMAX  rotdion,  the  above  patterns  stayed  the  same  except  for  the 
Ihrd  factor.  The  rotctedthW  factor  was  loaded  w*htt^variarx»<xxtholed 
ulizdkxirde$dnode6cndnode7.  Table  12  shows  the  rotated  factor  pattern 
of  the  Case  2  factor  andysfe. 

Factor  scores  were  again  obtained  by  rmJtptylng  the  eigenvectors  of  the 
factors  by  the  orignal  variables.  The  factor  scores  of  the  four  factor  of  the 
variance-cortroled  outputs  are  shown  in  Table  T3. 
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Scatter  plots  of  the  Itaffactor  against-  each  of  d  the  other  factors  ae  shown  in 
figures  13  throucfi  15.  The  ports  have  the  alphabetic  notcfion  of  the  design  port 
t  represents. 
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Table  12.  Rotated  Factor  Pattern  tor  Case  2 


Factorl 

Factor2 

Factor3 

Factor4 

TB 

-0.9936 

-00296 

-00046 

-00791 

U3B 

0.9961 

00363 

00178 

0.0660 

U4B 

0.0610 

0.9462 

-0.2510 

-0.1760 

U5B 

0.1067 

-0.0493 

-0.1168 

0.9835 

U6B 

0.0165 

-0.1188 

0.9779 

-0.1477 

U7B 

-0.0256 

-0.7173 

-05392 

-0.4924 

Tcfcte  13.  Factor  Scores  of  Case  2  Factors 


DesigiPoir# 

Factl 

Fad2 

Fact3 

Facf4 

1 

2.5286 

-00541 

00364 

-0.1212 

2 

0.8156 

1.6336 

-C.3483 

-0.6217 

3 

00706 

-03260 

-03320 

10228 

4 

02311 

1.4996 

-0.7967 

12181 

5 

0.7609 

-02197 

1.7336 

-05571 

6 

0.1946 

1.3471 

1.1539 

-0.9519 

7 

-0.1997 

-0.4144 

1.5630 

1.3205 

8 

-0.7680 

1.0698 

0.7899 

0.8980 

9 

0.8077 

-13602 

-1.1117 

-10196 

10 

-0.1977 

0.3703 

-15740 

-13157 

11 

-00384 

-12598 

-0.9628 

1.7967 

12 

-1.0286 

02937 

-1.5062 

0.4361 

13 

-0.1479 

-13307 

0.7646 

-1.1440 

14 

-1.3996 

0.1534 

0.3219 

-1.3484 

15 

-0.7586 

-15133 

03174 

0.5480 

16 

-1.6041 

02027 

0.1022 

0.0670 

17 

-00666 

-00918 

-0.1524 

-00173 
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Case  3  testis.  The  resit  of  the  regression  of  the  factors  and  the  means  of  the 
control  variables  testied  in  the  (blowing  four  equdtons: 

Zt(P)«Zi-  <2.06037*  V® 

Z2(P)  «Z2  -  <-2.771T9*Wi  +  2.09666*  W  7  +  221997*Ri) 

Z  2<p)  «Z  3  -  (2.58496*  Wi  -  1J 57872*  W5-3.39356*V^) 

Z4(P)-Z^ 


where  Zn(p)  js  the  vartance-cortroled  n-th  factor,  Zn  is  the  original  non-controled 
factor.  Wj  is  the  woridng  variable  of  node  j.  end  Rj  is  the  rolling  variable  of  node  j. 
Note  that  vaicnce-reduction  was  not  redzed  for  the  fourth  factor. 

The  vararce-ccrtroled  factor  scores  ct  each  design  ports  are  shown  in 
Table  14.  The  scatter  plot  ofthetlstvcikTx^cortroled  factor  agahsfeachofal 
the  other  vartance-cortroled  factors  are  shown  h  figures  16  through  18. 

Observations 

Both  sets  of  factors,  one  found  using  the  original  outputs  and  the  other  using 
the  vartance-cortroled  ortpufs,  explained  relcttvety  equal  amount  of  variances 
oftheorigirKJdata--abo(J,99%.  Simlatty.  each  hclvidua!  factor  of  the  original 
outputs  explained  a  telattvely  equal  percentage  of  the  variance  as  Is 
counterpart  factor  of  the  vartance-cortroled  outputs.  Further,  the  last  three 
factors  in  each  set  had  reldlvety  equd  eigenvalues  or  ej^lahed  equal 
amounts  of  the  variance. 

The  folowing  dscussion  restifiom  a  comparison  of  the  plots  of  the  factors  of 
the  original  outputs,  the  plots  of  the  factors  of  the  valance-cortroled  outputs, 
end  the  plots  of  the  vartance-cortroled  factors. 


62 


X 


Table  14.  Vartance-Conlioled  Factor  Scores 


Design  Port 

Factl 

Fad2 

Fact3 

Fad4 

1 

2.5736 

05762 

05129 

•0.1025 

2 

0.5667 

-03863 

13182 

-0.4211 

3 

0.8658 

0.7934 

-05022 

1.8666 

4 

0.4071 

-02466 

03347 

15100 

5 

0.5767 

-0.9516 

0.0079 

-0.9033 

6 

-05110 

-0.9493 

05061 

-1.1327 

7 

-0.8190 

0.1399 

-0.7461 

0.7936 

8 

-05607 

-02678 

-0.7675 

0.4367 

9 

0.5338 

0.1120 

-0.4682 

-0.7801 

10 

-05339 

0.9714 

03836 

-15224 

11 

-0.4397 

02478 

03526 

1.1574 

12 

-02833 

0.7116 

0.4699 

0.8731 

13 

02613 

-02417 

-15108 

-1.1645 

14 

-0.4831 

05094 

-03896 

-1.3903 

15 

-0.6310 

-02336 

0.0256 

02837 

16 

-1.7575 

-02617 

-05506 

-05417 

17 

0.0545 

-0.6538 

-0.5398 

0.0375 

1)  Ford  the  plots,  the  design  ports  for  the  slgriiltecrtixxjescfl^ 

and  low  levels  were  labeled  wihtricncjes.  The  design  points  which  have  three 
nodes  cither  Itcfi  levels,  20%  above  the  mean,  were  labeled  wlh  rectangles. 
The  design  ports  which  have  two  nodes  at  their  hiefi  levels  were  labeled  wih 
circles. 

2)  The  ports  representing  d  the  significant  nodes  cf  their  Nsfi  and  lowlevete 
occu  on  opposte  sides  ofthe  duster  of  poirts.  The  point  represerling  the  nodes 
cl  their  mean  levels  seem  to  be  in  the  mldde  of  the  ether  two  points. 

3)  Thepdtsseemtote^egressbg'dongfheflratfactoratfsasfhenLrnberof 

nodes  dtheir  levels  increase-the  rectangles,  as  a  whole,  are  behind  the 
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drdes,  as  a  whole,  which  are  behnd  the  urtabeted  ports  (which  represert 
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Figure  16.  Scatter  Plof  ofthe  First  and  Second  Vcrtcnce-Cortroied  Factors 
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havi^  only  one  rc>de  at  is  hicp  level.)  This  trend  appeas  very  dealy  forth© 
facfof  1  of  the  vartance-cortroled  outputs. 

4)  The  folowing  observations  are  mad©  about  the  Case  1  plots: 

a)  The  plot  of  factor  1  agdnsf  factor  2  seemed  to  hcwe  three  groipings  of 
ports-those  ports  wlh  rxxte  7  cf  tehic^  level  (characterized  by  the  presence 
of  the  letter  mg“).  those  ports  wlh  node  6  ct  Is  hicfi  level  (letter  T)  and  d  the 
olher  ports.  The  group  of  ports  wlh  node  7  cf  Is  high  level  wasthe  farthest  up 
the  factor  2  cwis,  whle  the  group  of  ports  wlh  node  5  at  Is  high  level  was  the 
farthesf  down  the  factor  2  cods.  The  goip  of  d  the  other  ports  was  between  the 
other  two  groups.  This  pattern  in  the  plof  was  reflective  of  the  facfor  pattern  of 
facfor  2.  The  rotated  facfor  pattern  of  factor  2  had  signittcanf  toadngs  for  the 
liizatton  rates  of  node  6  and  7.  The  loadngs  are  opposte  in  sign  end  the 
locKdhgfornode7wasbiggerinmagnlude.  Apparert1y,node7aflshi^level 
resiled  in  high  factor  scores  for  factor  2  whle  node  6  at  Is  high  level  resiled  in 
low  factor  scores  for  factor  2. 

b)  The  plot  of  factor  1  against  factor  3  seemed  to  have  two  goupings  of 
ports-those  ports  wlh  node  4  at  Is  high  level  (presence  of  the  letter  “d")  and 
those  ports  with  node  4  at  Is  low  level  (absence  of  the  letter’d").  Thegoupof 
ports  wlh  node  4  at  Is  high  level  was  above  the  group  of  ports  wlh  node  4  ct 
Is  low  level.  This  pdtem  in  the  plot  was  reflective  of  the  factor  pdtem  of  factor  3. 
The  rotated  factor  pdtem  of  factor  3  had  a  signittccrt  toadng  only  for  the 
uttbatton  rate  of  node  4.  Apparently,  node  4  at  Is  high  level  resiled  in  higher 
factor  3  scores  whle  node  4  efts  low  level  resiled  in  lower  factor  3  scores. 

c)  The  plot  of  factor  laganst  factor  4  seemed  to  have  two  groiprtgs  of 
ports-those  port  wlh  node  5  d  Is  high  level  (presence  of  the  letter  “e ")  and 
node  5  d  is  low  level  (absence  of  the  letter  “e").  The  group  of  ports  wlh  node 
5  ci  is  high  level  was  above  the  group  of  ports  wlh  node  5  at  Is  low  level .  This 
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pattern  in  the  plot  was  reflective  of  the  factor  pattern  of  factor  4.  the  rotated 
factor  pattern  of  factor  4  had  a  sigiikxitloacfng  only  for  the  utlzallon  rate  of 
nodes,  Apparently,  node  5  at  Is  high  level  resuled  n  hicper  factor  4  scores  wrtte 
node  5  at  Is  low  level  resiled  hlowerfactor  4  scores. 

5)  The folowing  observations  ore  madeaboutthe  Case  2  plots: 

a)  The  plot  of  the  first  and  second  factorsof  the  variance  reduced  outputs 
seemed  to  have  three  grotpings  of  poirts-those  ports  wih  node  4  cf  Is  hi^i 
level,  those  points  wth  node  7  cl  Is  Hgfi  level  and  d  the  other  ports.  The  group 
of  points  wfh  node  4  ct  is  high  level  was  the  farthest  up  the  factor  2  axis  whie  the 
gotp  of  points  wih  node  7  at  is  higfi  level  was  the  farthest  down  the  factor  2  cuds. 

the  other  points  were  between  the  other  two  groups.  This  pattern  in  Ihe  plot 
was  reflective  of  the  factor  pattern  of  factor  3.  The  rotated  factor  pattern  of  factor 
2  was  loaded  wih  the  vartance-cortroled  utizalton  rates  of  node  A  and  node  7. 
The  loadngs  were  opposfe  in  sigpi  and  the  toadhg  tor  node  4  was  biggern 
magriude.  Apparently,  node  4  d  Is  Ngfi  level  resuled  in  hic^i  factor  2  scores 
whie  node  7  at  is  hicfi  level  resuled  h  low  factor  2  scores. 

b)  The  plot  of  the  first  and  third  factors  of  the  vartance-cortroled  cxJpufs 
seemed  to  have  three  grouplngs-those  ports  wih  node  6  at  is  high  level,  those 
points  wih  node  7  at  is  high  level,  andd  the  other  points.  The  grotp  of  points 
wih  node  6  at  Is  hig^i  level  was  farthest  up  the  factor  3  axis  whie  the  goup  of 
ports  wih  node  7  cl  Is  high  level  was  farthest  down  the  factor  3  axis.  Althe  other 
points  were  between  the  other  two  groups.  This  pattern  h  the  plot  was  reflective 
ofthe  factor  pattern  of  factor  3.  TherotdedfcKtopdtemdfcdor3was 
loaded  wih  the  vatance-cortroled  rdes  of  nodes  6  and  7.  The  toadngs  were 
opposfe  in  sign  and  the  bacing  for  node  6  was  bigger  In  magnlucle. 

Apparently,  node  6  alls  high  level  resuled  in  hicfi factor 3  scores  whie  node  7  at 
Is  htg^i  level  resuled  h  low  factor  3  scores. 
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c)  Tbeplofo^ttT©iWcrKjfbu^fcK^o(tt^vcikT)c©<or<rcl©dotipU8 
seemed  to  have  two  goipings  of  ports-those  ports  wlh  node  5  efts  Ngfr 
level  and  those  portswih  node  5  cf  Is  low  level.  This  pattern  in  the  plot  was 
reflective  of  Ihe  factor  pdtem  of  factors  The  rotated  factorpclterncffbctor4 
was  loaded  solely  wlh  the  vartance-cortroledulizcllon  tale  of  node  5. 
Apparently,  node  5  at  Is  higfi  level  resiled  in  rtcfier  factor  A  scores  wtile  node  5 
at  Is  low  level  resiled  in  lower  factor  4  scores. 

6)  The  folowing  observations  are  made  aboetthe  Case  3  plots: 

a)  No  dBcerribte  pdtem  was  found  in  the  plot  of  the  variance-controled 
factors  land 2. 

b)  No  dscemtole  pdtem  wasfotnd  inthe  ptdofthe  variance-corlroled 
factors  T  and  3. 

c)  The  plot  ofthevaroTceaortroled  factors  T  and  4  seemed  to  have  two 

grotprngs  of  ports-fhose  points  wlh  node  5  at  Is  level  and  node  5  at  Is  low 

level.  The  group  of  ports  wfh  node  5  dts  hk^i  level  are  above  the  grexp  of 
ports  wlh  node  5  at  Is  low  level.  The  interpretation  of  ttis  plot  pattern  was  simiar 
to  the  interpretation  of  the  plot  of  the  first  and  fourth  factor  of  the  original  variables. 

7)  Of  d  the  plots,  the  Case  2  plots  haa  the  clearest  cfctinction  between  the 
grotp  of  ports  wlh  three  nodes  at  their  rtc^i  levels,  the  grocp  of  ports  wlh  two 
nodes  attheir  Ngfi  levels,  and  the  group  of  ports  wlh  just  one  node  cl  Is  Ngfi 
level.  There  was  a  very  dear  separation  along  the  factor  1  axis.  An  exploration 
forttisisttylthevciicix:eintt^ori^nddclahasbeenredLx:ed  The  "noise"  that 
was  in  the  ort^nd  data  was  causing  the  ports  to  stray  to  the  other  groups  of 
ports;  control  variates  prevented  this  straying. 
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YL  ConcljaQr&cixj  Recommertad^ 


The  pupose  of  this  thesis  was  to  compae  the  vaicnce<xxlroledcnd 
urortroledprtrK^componertsd^  The  conclusions  of  It* 

research  are  important  because  they  add  to  the  body  of  knowledge  thd  an 
andyst  draws  upon  when  faced  wih  problems  of  data  and  varicnce  reduction. 

This  research  was  accompished  because  the  study  of  prinqpd  components 
analysis  wih  the  technique  of  control  varides  has  not  been  performed  before.  I 
was  dso  the  hope  of  the  researcher  thd,  given  adud  systems,  the  resufrs 
obtained  from  the  study  would  make  possble  an  assessment  of  real  systems. 

For  example,  given  two  computer  systems  wih  dfferent  node  mean  service 
times  and  probab»es  oftrcnstions  or  two  simlar  systems  wih  different  settings,  an 
index  or  a  couple  of  hdces  <Jhe  prlnc£d  components)  can  be  used  to  rde 
each  system.  A  judgement  such  as  degee  of  efficiency  or  need  for 
rrKxJIcationsccnthenbeirripledfromthisIxjexorsetofindfces.  Control 
varides  can  then  be  performed  to  Tine  tune"  the  index  or  set  of  hdces. 

The  methods  cf  comparison  used  in  this  study  was  to  examine  the 
percentage  of  the  total  variance  explained  by  the  principal  components  and 
to  review  the  scatter  plots  of  the  first  two  prindpd  components . 

In  Case  1,  the  fotr  prindpd  components  were  found  to  be  significant  and 
explained  99 .4%  of  the  told  variance .  In  Case  2,  tour  prindpd  components 
were  also  focnd  to  be  significant  and  e>^ldned  99.3%  of  the  total  variance,  for 
each  set  of  prindpd  components,  the  last  three  had  reldtveiy  equd 
eigenvdues-the  proportion  of  variance  each  explained  were  equd.  The 
scatter  plots  yielded  by  the  three  cases  of  dda  presented  simld  patterns. 

One  can  conclude  thd  the  resuis  obtained  from  the  princ^pd  components 
andysis  are  inconclusive  and  ambiguous.  However,  severd  explanations  can 
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be  vofciteered  forthe  resits.  The  network  model  had  several  utfortunde 
characteristics  thd  resiled  in  the  unclear  outcomes.  The  nodes  4  through  7 
cortrbufedequdciek^  to  a  customer's  mean  time  in  system.  None  of  these 
nodes'  effects  were  dowed  to  override  any  of  the  other  node  effects.  The 
equal-delay  chaacteristfc  may  dso  have  resiled  in  the  equal*  valued  principal 
components,  ^so,  the  model  routings  and  configurations  seemed  to  have 
created  nonorthogonat  principal  components.  Node  7  loaded  wth  ether  node 
4or6dependhgonthecondflons.  The  pdnlcpal  components  plots  had 
characteristics  that  support  this  explcndfon. 

A  factor  andysts  of  the  same  d da  generded  some  efferent  resits.  The 
factor  patterns  were  simlarforboth  types  of  analyses  butthe  plots  were  efferent. 
Factor  analysts  of  the  variance-controled  outputs  yielded  more  dsttnet  “breeks* 
between  the  groups  of  ports  dong  the  tirltdetor  axis;  control  varides  was  d 
work.  Nso.  the  plots  of  the  factors  of  the  variance-controled  outputs  are  more 
easiy  interpreted  than  the  plots  of  the  factors  of  the  variance-controled  factors, 
/^pparentty.  control  verdes  perfromed  before  factor  analysis  resiled  h  less 
noise  in  the  find  dafa-resils.  in  terms  of  plots,  are  better  if  variance  reduction  is 
accomplshed  before  factor  analysis .  More  impoitantty,  the  factor  patterns  of 
the  factors  were  more  easiy  observed  on  the  plots  than  the  factor  patterns  of 
Ihe  prindpd  components. 

The  observations  and  conclusions  thd  were  made  suggest  the  folowing 
recommendations. 
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Recommenddions 

As  was  mentioned,  the  "metrics"  used  in  the  comparisons  were  percentage  of 
the  totd  variance  exported  by  the  prindpd  components  and  a  review  of  the 
scdterplcts.  fothermodes  of  measurements  or  measures  of  effectiveness 
(MOEs)  were  used  in  the  comparison,  more  mecrin^U  resits  may  have 
resufed.  Explanation  for  the  dfferences,  h  addfion  to  flndng  the  dfferences, 
could  have  been  made. 

Arx#^  recommendation  is  to  change  the  technique  used.  Case  1  resits 
fond  four  principal  components.  The  lastthree  principal  components 
explained  reldively  equal  percentages  of  the  total  variance.  There  may  have 
been  other  types  of  analyses  thct  could  have  produced  dearer  resits. 

Another  recommendation  is  to  select  another  model  for  study.  This  charge 
may  be  ether  changes  in  the  parameters  v  alues  such  as  mean  service  times  or 
probabWes  of  transflon  or  a  dfferenf  model  entirety.  The  resits  the  current 
model  is  producing  are  unclear.  The  system  makes  it  dfficut  to  determine  which 
node  or  nodes  are  critical  to  forming  the  prinepd  components  or  to  reducing 
varicnce. 

A  final  recommendation  is  to  select  a  ciTerent  set  of  outpcls  to  study.  Perhcps 
the  outputs  used  in  this  research  are  not  as  conducive  to  the  types  of  analysis 
used  as  another  set  mieft  have  been. 
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c  program  ir>3«Xinptf,odp(iJcpe5«^ 

c  Itcpe2jcpe3jape4) 

c ******************************************* 

c*  Main  Program  -  Begin  * 

Q ******************************************* 

C 

progam  mar 
dmension  nset(5000) 
common  qsei(5000) 

common/scoml/  aM^l^ckXIC^.ck^lO^^cIrvowj/rfajT^op/x^ 

1  />adr/pfrt/rifiii/ri$eritape^  1  00),$$J(  1 00)  jnexf jnowM  1 00) 

common/ucoml/  depat(10)/nTTeaX^P<10J0)-ser\^l(0.ecourt<2^ 

common/ucom2/  isttx:ap/iusssn/tjmcusfid©^ 

common/ucom7/  nume>qD,  deta,  xmearKlO),  z 

equivalence  <nset(l),qset(1» 

integer  numexp,  z 

red  defa,  xmean,  imean 

mset=5000 

r>crdr-5 

npnt-6 

nrape-7 


read  (ncrdr *)  isub<xp/iusssn/xiT>cusf 
c 

do  10  nIjxbssth-2 
read  (ncrdr  *)  <p04)-j-lJTusssn+2> 

10  continue 
c 

open(unl-10fle-p750.edm;srctus-,c4d’) 
reacKlO  *)  numexp,  dela  (xmean(i)j-1  jmsssn+2) 
c 

openCunt-15j*e-,p790.op'/stcfus-,new,> 

c 

cal  slam 

dose(10) 

dose(15) 

stop 

end 


c*  Main  Program  *  End 

c *******************. 

c 

q  *******************1 

C*  SUBROUTINES 
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c*t***t***Mt*******«***M**MfM**M***MM 

c 

c ******************************************* 
c*  Subroutine  EVENT  * 

c ******************************************* 

c 

subroutine  evert(l) 

common/scomV  <±b<100)#clcK100Xclcl(100),ctnowJ/rfa^ 
l/>ac*’/pflt/¥irm/Tnset/#c^^l00><s$K100)jnerfjnow^l(B) 
common/ucom  V  dep<^10);rraan(1(ftp(^ 
common/ucom2/  isulxxp  jusssnjuTKXisr^^ 
c 

ecourt<l>ecourt<l)+l 

ignow.^rdea)  ecourt(2>ecourtC2>+l 

goto  0j2)j 
c 

1  cal  ass 
return 

2  cdendss 
return 
end 

******************************************* 

*  Subroutine  INTLC  * 

******************************************* 

subroutine  Mtc 

common/scoml/  afrib<  1 00),dd(  1 00),ddK  1  (XJ),dhX3wi/rta/nstopjtdnr 
1  /x^dr/prrt/inrun/riset/tc^,s$<  1 00),s$K  1 00)  jnext jnow^cx(  1 00) 
cornmon/ucornl/  depart{10)jmean(  10),p<10  J0)^ervt(10),ecount(2) 
common/ucom2/  tsubccp/xisssn/umcu^ 
common/gcom5/  isecKlO)  Jbegjdr/nmnf/nmonj^^ 
&YK^/inptjinpij^jTrTm$^ 
common/ucom3/  muUno<7) 
cornmon/ucom7/  numexp,  cleta,  xmeanCIO),  z 
corrrnonA»com9/ leveKlO) 
integer  i$eed(2000),  numexp,  z 
real  deta,  xmean,  rmean.  level 
c 

c ************************************* 
c  *  Read  in  parameter  levels  from  * 

c  *  design  mdrtx.  end  set  parameters  * 
c  *  accordncty  * 

c ************************************* 
c 

read(10 *)  <tevet(i)J-1(nusssn+2) 
do  10  i-l/iusssrH-2 

rmean(I)  -  xmeaXO  +  0eveKi)*<deta*»Dean(i») 
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So  So  So  Soooooo 
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10  conlinue 


c 

c 

c 

c 

c 


*  Create  new  seed  for  each  run  of 

*  the  experimental  design  matrix^ 


t  <<<<2*n^ne^Hl)-nra^)©q-0) then 
j-(1  fle402)*drand(l) 
do  15  i-fmn,  (<rmmnume>p>l) 
iseecKXH 

15  conlinue 
z-z+1 
encf 

ised(2>iseed(nrTm) 

x=-drand(-2) 

c 

c ***«****************************< 
c*  Inttalze  vectors  and  variables 
c**********************^********> 

c 

do  201-17 
mulino(i)-0 
continue 


* 


* 


do  251-17 
ecourt<i)-0. 
continue 

do  30  i-l/msssn+3 
depat(i)-0. 
continue 

do  35  i-l/iusssm-2 
servJ(i)-0. 
conlinue 


SchecUe  each  customer  for 
inflci  evert 


do  40  i-1  jxiDCust 
etime-expon(imean(l)7) 
drib<l)-^lme 
ahb(3)-l 
aht*4>l 
aWb<5>2 

cd  schdKLettme.ahto) 
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cortinue 

do  46  i-l/iusssrH-2 
xx(i>0. 

46  continue 

wrte<6i00)rmnjTrne>p 

200  foimat(lx/SIMULAT10N  STUDY  IN  PROGRESS :  RUN  A '  OF 
&14/  RUNS’) 
return 
end 
c 

c ******************************************* 
c  *  Subroutine  ENDSS  * 

c ******************************************* 

c 

subroutine  endss 

corrmon/scomV  cW^W^ddC^^ddK^.dh^wJjrfa/nstop/KiT 
1  /K^/Tpfnt/rifun/Tnser  1 00)<tnextjrx>w^x(  1 00) 

common/ucoml/  depat(10)jrnecin(ltyp<10J0^ 
common/ucom2/  isubccp/TusssnjxrTaist’idec^ 
common/ucom3/  mulino(7) 
c 

cd  scnd(lO.,ahtD) 
myq-atrib(4) 

c 

t  (rmq(my q)  ne  0)  then 
cd  rmove(1jTTyc|.atrb) 
wd-tnow-aWb(2) 
cdcc4ct(wd/nyq) 
rm-rmean(nrryq) 
seivice-ejqxxxrm^) 
ctrib(4>otit><5) 
jd*ofriD<4)+. 00001 
cd  nerfguyOdjnext) 
c 

c ************************************* 
c  *  COLLECT  STATISTICS  WHILE  PARKED  * 

C*  AT  CPU  * 

c ************************************* 

c 

f0afeq.3)then 

muiirK>(ine>t><Txtt^^ 

endf 

c 

cWb(5)-inetf 
cd  schd(2^ervlce,aWb) 
t  (tnow.cf  Jdear)  then 
seM<myqHefVt<rnyqHsewlce 
dep^myq>depat<myq>+1 
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depaKnusssm^-depaKnusss^ 

end 

else 

xx<myq>0. 

©net 

c 

jf(myq.eq^.axjm^2)^iJ.cr^jsLlxxpj^J}.cixljne^.eq.l 
&.andmq(myc|)n©i))  then 
cd  imove<l,2,cWb) 
service-0. 
aht><4)-dTto<5) 
cfrib(5)-3 

cd  schdK1,serv>ce,aht)) 
end 
c 

return 

end 


c 

c ******************************************* 
c  *  Subroutine  ARSS  * 

c ******************************************* 

c 

subroutine  ass 

common/scoml/  aWb<  1 00),dd(  100),dcl(  1 00),dhx>w  j/rtfa  jnstop/K*T 
1  jiadupn^/rirun/ir^  1 00)  jnexf,}now^x(  1 00) 

common/ucom  V  depat<10)^TTecn(10)p(10J0)^efvf<10),ecourt(2) 
common/ucom2/  isubc<p  jiusssn/iumcusf^^ 
corrrnon/ucom3/  mutino<7) 
c 

id»aWb(5) 


f  (icf.eq.l)ttTen 
re$p-tnow-oMb<l) 
cdcoIcKrespJ) 
mrwmeanO) 
service-e>qooo(inni) 
drto<l)-tnow+seivice 
aWb(4>l 
atrib(5>2 

cd  schd(l^efvice,afnb) 
if  (tnowdtdear)  sen^id)-seM<id)+s©rvice 
goto  101 
end 


if0d.eq2)then 
t  (IsutxxpneO)  Itien 
numsub-0 
do  10  W/tusssth-2 
nlJTlsub-nJ7lsub^^T^q(i> 
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10  continue 

1  (numsub  1  j$Li>cap)  then 
f(rmq<2).eq.0)then 
wd-0. 

coicotcKwct^) 

servtce-0. 

cWb(4)-2 

aWb<5>3 

cd  $chcKl,service,aht>) 
goto  101 
else 

aftb(2Hnow 

cdttem(2,aMb) 

cdnroveOZaMb) 

wd«4now-afflb<2) 

cdcolct<wd,2) 

atnb<4>»2 

atrib<5)-3 

servtce-0. 

cd  schdKlservice.aWb) 
goto  101 
end 

afrib(2)-tnow 

cdfflerrK2.aMD) 

return 

end 

endT 

end 

100  r(xx0d).gt.0.)then 
atrt<2>4now 
cdtlemOd.drib) 
return 
else 
wd-0. 

cdcolcKwdjat) 
rm-rmeanOcf) 
atrtX4>4at 
cd  nextguyOatjnext) 

c 

c *******************************. 

c  *  COLLECT  STATISTICS  WHILE  PARKED 

c*  AT  CPU 

£*******************************■ 

c 

f(iateq.3)then 
rrxiirxXinext>«frtiirxX  1 
end 
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aWb(6>Hn©xr 
$e»vice-expon(inri2) 
xx<iaO— 1 

cd  $chd(2,$efvice,afTto) 

Iflnow.gfJclea)  se<vt(ki>sefvt(k^s©Mc© 
encff 
c 

101  f(!now. endear)  then 

depatCic^)-depcit0d)+1 

depaKnusssn+3>d^^  1 

end 
c 

return 

end 

c 

c ******************************************* 
c  *  Subroutine  NEXTGUY  * 

c ******************************************* 

c 

subroutine  netfguy(iar jnext) 

common/ucoml/  depat(10)<irne<y<10)p(10J0)<ser^l0),ecourl(2) 
common/ucom2/  isLtocqD/iusssn/iunxxist^dea 
c 

CUD-0. 

u*urttm(0.,l.,2) 

c 

do  10  hdex-lDusssn+2 
curr^cum+pOatjndex) 
if(uJe.cum)then 
inexr-index 
goto  15 
etse 

continue 

end 

10  continue 
c 

15  return 
end 
c 

c ******************************************* 
c  *  SLfcrcxflne  OTPUT  * 

c ******************************************* 

c 

sifcfocfine  otpif 

common/ scorn  1/  clrtX100),dd(100)/dci(100).dx>wJ/Tta/nstopDctT 
l/x^/prrt/mr/inset/tape^lOOJ^^jne^inowx^lOO) 
common/ucoml/  depat(  1 Q);rnecn(  1 0)p(  1 0, 1 0),$en/t<  1 0),ecourt(2) 
common/ucom2/  isitccp Ajsssn/imcust Jdecr/Btudy 
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conrr>onAKxx^ 
connmonAJeomQ/  leveKlO) 
real  level 
c 

wife<15  *)  ccavg(l),  <level(i)>l/iu$ssn+2) 
c 

wite<l 

wrtte<1*Xecotxt(l»-1^) 
wjfe(l*Xccavg(i)>l/iusssn+2) 
wife<l*XltavgOJ-2/uj88sn+2) 
wrfe<l*XsefvXl»l(nusssn+2) 
wiie<1*Xclepat(l)>1<nus$8rH-3) 
isum-0 
do  101-17 
feurrMstirwfn^^ 

10  corUnue 

vrtfe(17XnTUlino<j)>l7)jSLrri 

c 

return 

end 
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5  5  252000.1 
0.1. 0.0. 0.0.0. 

0.0. 1.0. 0.0.0. 

2  0. 0.  .36 .36 .04 .04 
0.0. 1.0. 0.0.0. 

0.0. 1.0. 0.0.0. 

0.0. 1.0. 0.0.0. 

0.0. 1.0. 0.0.0. 

GENJ^auermodel  no  15,6/5/86/20Aayji/i; 
UMrTS.7.5,200; 

STAT.l  jeponse  time; 

STAUwats*or2; 

STAUwat$fc*3; 

STATAwatsfalA 

STAT,5,wct$fcf5; 

STAT,6.wc*staf6; 

STAT,7,watsfcf7; 

HMST,XX(l)jeiminGls; 

TlMSU0«2).cpu; 

TIMStXX(3),ciskl; 

TIMST/XX(4),clsk2: 

HMST^5).dsk3; 

T!MST,XX(6),cisk4; 

TIMST,XX(7),cIsk5; 

INITIALIZE.0.,5000.; 

MONTR,CLEAR2000; 

SEEDS.34444066917O); 

m 
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options  ine$ize-78; 

data 

rile  fact 

inp(/yxlx2x3x4x5x6x7; 

xl2-x1*x2; 

xl^xl*x3; 

xl4«xl*x4; 

xl5-xl*x5; 

xl6-x1*x6; 

xl7-x!*x7; 

x23-x2*x3; 

x24-x2*x4; 

x25-x2*x5; 

x26-x2*x6; 

x27«x2*x7; 

x34-x3*x4j 

x35-x3*x5; 

x36-x3*x6; 

x37«x3*x7; 

x45-x4*x5; 

x46-x4*x6; 

x47»x4*x7; 

x56«x5*x6; 

x57-x5*x7; 

x67«x6*x7; 

proc  stepwise; 

model  y  -  xl  x2  x3  x4  x5  x6  x7  xl2  x13  x14  xl5  xl6  x17 

x23  x24x25  x26  x27  x34x35  x36x37  x45  x46  x47 
x56  x57x67; 


Append*  3.  POST.FOR 


C - C 

C  This  program  tckes  a  dda  fie  generded  by  M15.F  an d  C 
C  complies  canddde  corttolvaridolesfdlrpdirto  C 

C  SELECT.II.F.  Spealkxiy,1ttsprogamusessummed  C 

C  service  times,  probabiles  of  IrcnslJonhgftom  C 

C  the  CPU  to  a  partlaJar  node,  the  steady  state  C 

C  p»ob<P«esc<  being  h  a  patkxtar  node,  and  the  C 

C  adudrxjmberofcusfon'^franstVonir^fr^  C 

C  toapaMcitanode,ciKJcdCLfcte  C 

C  work  and  roiling  variables.  C 

C - C 


program  mkdda 

parameter  <numrep$-20) 

integer  cp 

realrm(7)p<7)pi2(7) 

real  r(13),w(7),e(8) 

integer  mut(8> 

real  wrkv(7) jrnul(7) 

real  ym(13),ymb(T3) 

red  wk^wl^OO.wto^.wkvCT) 

red  rt<7)jt2<7)jtb<7)jlv<7) 

c - 

c  DATA  FOR  DESIGN  POINTT 
c  Thefolowing  dda  are  attributes  of  the  model, 
c - 


data  dp /V 

C  im  are  the  mean  service  times  by  stdlon 
ddtawn/W.AU22V2242)joy 
C  pi  are  the  steady  stale  transifon  probabiles 
data  pi  /i)9.D9,.46,.16,.16,TE,.02/ 

C  p!2  are  the  adud  brcrching  probabiles  from 
data  pQ. 


CPU 


c - 

c  dpi  dd  is  a  dda  fie  generded  by  M15.F, 
c  the  smidton  of  the  model. 


o 


open(urt■20Jle-,dp^.dd,4tdus■,old■) 
do  TOhTjxrrreps 
CRUN# 
read(20*XT 

C  Totd  ever#  court.  Ever#  court  from  TCLEAR 
read(20*)f2/3 


u 
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C  RESPONSES 

re<xX20*X«i)i-l7> 

read(20*XXi)J-6.13) 

C  SUMS  of  Sefvice  Times  by  Station 
r©acK20*Xw(D>-l7) 

C  TOTAL  DEPARTURES  by  Station 
read(2O*Xe<i)j-l0) 

C  Told  Depctiiesltom  CPU  to  Station  j 
read(20*Xrrtf<I)>1.8) 

do  20  j— 1.7 


o 


c  wrkv<j)  Is  the  sfandardzed  work  variable  of  node  j 
c - 


7(nTXX>JTe.0.)ttTen 

wikv(JHw(j>-e<j)*  rm(T»*  (sqpf(e<j))/(pKj)*  ©<8>*  rm(j))) 
endf 


c- 


crmLflQ)  is  the  idling  variable  of  node] 
c - 


jf<J.eq.2.orj.eq.3)then 

else 

nriL#(jHmLf<j)HT^  pi2(j» 
&  /sqrKpi2(j)*<l.-pi2(j))*mut(8)) 
endf 

20  continue 


c  ym(j)  Is  the  sum  of  response] 


do30j-U3 
yrn^yrrXj)^ 
30  cortinue 


c - 

cwk<p  is  the  sun  of  work  variable] 

cwk2(j)  is  the  sun  of  the  squares  of  work  varictolej 

cit<j)isthesiiTiofrocl1ngvcik±)lej 

c  rt2<j)  Is  the  sun  of  the  squares  of  rotting  variable  J 

c - 


do40j-U 


wk(j>»wk(j}+w!kv<j) 
wk2<j)-wl5<j>f  wrtw<j)*  *2 

40  continue 

operKirMOJIe-’regl  .dar/stc<ijs-‘new,> 
wrfe(30*Xl)X9)Xl®Xll) 

8X12)X13) 

vflle<X*)v^{lXvrtkv(3),wikv(4) 

&.wrkv(5),wrkv(6),wrt<v(7) 

v^e<30*)flTiiiiK1Xn7^ 

5urnuX6)jrnul<7) 

10  continue 


c  ymb<j)  is  the  mean  of  response  j 


do  50|-113 

yrrt^ymQ/(float(nurrreps)) 
50  continue 


c - 

cwktXDistherneanofwofk  vak±>tej 
c  ittxj)  is  the  mean  of  routing  vartcbtej 
c  wkv®  is  the  variance  of  woik  variable  j 
c  rtv(j)  is  the  variance  of  routing  variable  j 
c - 


do60j-l,7 

wkb<j>v^(j)/(f)oat(nunTeps)) 
rttXj)^/(flocXnurTfeps 
60  continue 

do  70  j- 17 

^(PKw^O/OkxXnurnreps-l)))  - 
8<(ttocXnurnrep8/(numreps- 1  )))*  wkbfi)*  *  2) 
ftv<JHrt2<])/(fioat(nLiTfep8- 1)))  - 
^(flo^ixrrTeps/CruTTeps-l^^rttXD’^T) 

70  continue 

openCurt-lOJIe-'posM  ot/'Xtfus-'new') 
wrfe<10,555) 

556  fOfmcXlx,'WELCOME  TO  TAPE10 :  SUMMARY  OF  POST  PROCESSING'/) 
wtte<10,560)cto 

560  fomncXlx,THIS  IS  DESIGN  POINT  J2/  POST  PROCESSING'/) 
wrte< 10,565)ruTTeps 
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566  fo^mct<^x.,DP^has’j6;leplcc^lons,/) 
write< 10,570) 

570  formatOx/Below  ere  the  sampl©  means  of  the  responses’/) 
wite<10*)yiTnb 
wrf©<  10,57b) 

575  formcfOx/Belowarethe  means  of  the  work  variables'/) 
write<10*)wkb 
wrte< 10,580) 

590  foimaKlx/Betow  are  the  variances  of  the  work  variables '/) 
wrfe<10,*)wkv 
wrfe<10,566) 

586  format(lx,'Betow  are  the  meens  of  the  rotting  vcrables'/) 
wrfe(10,*)rtb 
wrfeOO^O) 

590  forrnaKlx/Betow  are  the  variances  of  the  routing  variables’/) 
wrte(10,*)»tv 
stop 
end 
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fopencix  4.  SAS  Code  to  Qttain  Vcikyce-C^clec^^ 


options  lne$ize-78; 

data; 

infleregl; 

ipi#tu3u4u5u6u7w1  w3w4w6w6w7rlr4i5r6r7; 
proc  stepwise; 

model  t  -  wl  w3  w4  w5  w6  w7  rl  r4 16  f6; 
proc  stepwise; 

modelu3«wl  W3w4w5w6w7rlr4i5i6; 
proc  stepwise; 

model  u4  ■  wl  w3  w4  w6  w6  w7  rl  r4 16 16; 
proc  stepwise; 

model  u6  «  wl  w3  w4  w6  w6  w7  rl  r4 15 16; 
proc  stepwise; 

model  u6  -  wl  w3  w4  w6  w6  w7  rl  r4  r6  r6; 
proc  stepwise; 

model  u7  -  wl  w3  w4  w6  w6  w7  rl  r4 15  r6; 
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opHons  lnesize»78; 
data 

ttlethesisb; 

Inpiftu3u4u5u6u7w1  W3w4w6w6w7rlr4r6i6r7 
pclpc2pc3pc4pc5pc6; 
proc  stepwise; 

modelpcl-wl  w3w4w5w6w7rlr4i6f6; 
proc  stepwise; 

model  pc2  -  wl  w3  w4  w6  w6  w7  rl  r4 16  r6; 
proc  stepwise; 

model  pc3  »  wl  w3  w4  w5  w6  w7  rl  r4 15  r6; 
proc  stepwise; 

model  pc4  -  wl  w3  w4  wfi  w6  w7  rl  f4  r5  r6; 


options  lnesiz©-78; 
data  non- 
Metheslsb; 

inpuft  u3  u4  u6  u6  u7  wl  w3  w4  w6  w6  w7  rl  r4 16  f6  r7 
pci  pc2  pc3  pc4  pc5  pc6; 

proc  factor  dcfa-non  rotafe-varimax  score  aisfaf-save; 
vartu3u4u6u6u7; 

proc  score  data-non  score-save  otf-scores; 
procpkrt; 

ptotfactor2*factorl; 

nror  nlnT’ 

plot  facfor3*facfor  1 ; 
proc  plot; 

ptottactotf'I'actorl; 

procprtt 

var  t  u3  u4  u6  u6  u7  wl  w3  wA  w5  w6  w7  rl  rf  r5  tb  r7 
focforl  factoi2  factor3  factory 


options  inesize-78; 
data  con; 

IrtlesTep; 

inpatb  u3b  u4b  u6b  u6b  u7b; 

pfoc  factor  dcfa-con  rotate-vahmax  score  odstaf-save; 

vartb  u3b  u4d  u5b  u6t>  u7t>; 
proc  score  dcta-con  score-save  oit-scores; 
procplof: 

ptoffacfor2*facfor1; 

procptof; 

ptot  factor3*factor1  ; 

OfOC  Diet- 

ptoffodor^actorl; 
proc  part; 
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